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FOREWORD 



For more than a decade declining college admissions , test scores have posted serious questions 
for school administrators, board members, teachers, and the public. Standardized college ad~ 
missions tests such ss the College Entrance Examination Board's Scholastic Aptitude Test and the 
American College Testing Program's battery of tescs are often viewed as barometers of school and 
program effectiveness and as indicators of a person's native intelligence, although these tests 
were not designed to fulfill these functions. 

How serious is the decline in college admissions test scores? Hov can the downward trend in 
SAT scores be reversed? What are the implications for students, schools, and communitjes? These 
are siome of the hard questions that school boards and school policy makers have attempted to answer 
since the mid-1970s. In some instances, intensified inquiry into the transition from high school 
to college has resulted in a reorganization of t;>i^+ff^lL^chool curriculum, a mandate for minimum 
competency testing, and an expanding debate over^the role of standardized testing in American 
society. Public attention Is now focosed on the debate between the makers of standardized testH 
and numerous test critics Including consumer advocates, public interest groups, and some educator 
organizations. Standardized tests such as the SAT anc ACT are the object of intense scrutiny to 
determine whether they are, in fact, valid, reliable, and able to predict a person's potential to 
perform college-level work. 

This ERS Report provides a comprehensive review of recenc trends in college admissions test 
scores, as well as an objective analysis of major issues affecting college testing. The Report 
summarizes the debate between consumer advocate Ralph Nader and the Educational Testing Service, 
rhe issue of special preparation for the SAT, and recently enacted and proposed truth-in-testing 
legislation that would regulate the testing agencies. Also included are two surveys that provide 
valuable information concerning the use of test scores by colleges and universities. Statements 
from well-known educators present a variety of perspectives on how test scores might be improved. 
Some tentative conclusions based on the data and information currently available are presented. 

We hope that this Reporu will be useful to school administrators, board members, teachers 
and others who must deal with the numerous and highly complex issues affecting testing for 
college admissions. 

Olen Robinson 
Director of Research 
Educational Research Service 



y J 



ERIC 



ACKNOWLEDGEMENTS 



ERS appreciates the many contributionb made by educational organizations, professional educa- 
tors, and concerned individuals in the preparation of this Report. ERS gratefully acknowledges per- 
mission to use excerpts from the following publications: v 

"A?T Assessment Test Scores — 3rd Year 'n Row for Increase," Activity^ May 1980, p. 4. Copy- 
right 1980 by The American College Testing Program, Iowa City, lA. 

An Agenda for Action: Reccrmendations for School Mathematics of the 1980s. Copyright 1980 
by the National Council of Teachers of Mathematics, Reston, VA. 

ATP Guide for High Schools and Colleges 1979-81. Copyright 1979, 1980 by the College Entrance 
Examination Board, New York, NY. 

Guide to' the Admissione Testing Program 1978-79. Copyright 1978 by the College Entrance 
Examination Board, New York, NY. 

"Joint Statement 'otx Principles of Good Pr;ictice in College Admissions and Recruitment." 
Published in **Self-Regulation Initiatives: Guidelines for Colleges and UaiversitJ es , " 
October 1979, p. 2, by the American Council on Education, Washington, IX:. 

Measuremc and Testing: An MA Perspective. Copyrighc^ 1980 by the National Education 
Association, Washington, DC. 

National College-Bound Seniors, 1980.. Copyright 1980 by the College Entrance Examination 
Board, New York, MY. 

National College-Bound Seniors, 1979^ ,Copyrlght 19/9 by the College Enhance Exatnlnation 
Board, New York, NY. 

National Report College-Bound Seniors, 1978, 1977 ,_ 1973^76 . Copyright 1978, 1977, 1976, 4975 
by the College Entrance Examination Board, New Yorit, NY. 

"National Testing Movement." Basic Policy Statement, Resolutions on Education. Adopted in 

1979 by the National AtJsociation for the Advancement of Colored People,, Washington, DC. 

"Recomroendations for the Preparation of High School Students for College Mathematics Courses." 
Published by the Mathematical Association of America, Washington, DC. 

"The Scholastic Aptitude Test: A Critical Appraisal," by Warner V. Slack and Douglas Porter. 
Publlw-hed in the May 1980 issue of che Harvard Educational Review, pp. 154-175. Copyright 

1980 by the President and Fellows of Harvard College. 

Searching for the Truth about "Truth-in-Testing** Legvslation: A Background Report, Report 

No. 132, by Rexford Brown and Merle Steven McClung. Published in January 1980 by tne Education 

Comaission of the States, Denver, CO. 

"Statement of Factual Correction and Rebuttal to Educational Testing Service Memorandum in 
Opposition," May 18, 1979, by New York Public Interest Research Group, Albany, NY. 



10 



Testj Scores and Family Income. Copyright 1980 by the Educational Testing Service, Princeton, 
NJ. 

Test Use and Validity, Copyright 19C0 by the Educational Testing Service, Princeton, NJ. 

ERS would also like to exnend special appreciation to the following individuals for their 
contributions tj^this publication: Rexford Brown, Director of Publications and User Products, 
National Assessment of Educational Progress; Hugh L. Carey, Governor of the State of New York; 
Roger Farr, Professor of.. Education at Indiana University and President of the International Read- 
ing Association; George H. Hanford, President ot the College Entrance^pxamination Board; Shirley^. 
A. Hill, President of the National Council of Teachers of Mathematics ; - Stanley H. Kaplan, Founder 
and President of Stanley H, Kaplan Educational Center, Ltd;; Nancy Kofcus, Guidance Project 
Specialist, Fairfax County Public Schools, Fairfax, VA; Kenneth P. LaVallc, New York State Senator, 
(R); Merle Steven Mc^lung, Director of the Education Conjnlssion of the States Law and Educ^tign 
Center ;^Willard H. McGuire, President of the National Education Association; Ralph Nader, Consumer 
Advocate; Allan Nairn, Consumer Advocate js^Vito Perrone, Dean of the Center for Teaching and Learn- 
ing, the University pf North Dakota; LevrLs W. Pike, National Institute of Education ;, Alan C. 
Purves, Principal of University High School at the University of Illinois and President of the 
National Council of Teachers of English; Diane Ravitch, Associate Professor of History and Educa- 
tion, Teachers College, Columbia University ;'>Philip R. Rever, Director of the Washington, DC, 
Office of the American College Testing Program; Scott D. Thomson, Executive Director of the 
National Association of Secondary School Principals; Shelia Tobias, Member of the Board of Curators 
at Stevens College and author of Overcoming Math Anxiety; William W. Turnbull, former President 
of the Educational Testing Service; James G. Ward, Director of Research, the American Federation 
of Teachers; and Ted Weiss, U.S. Representative (D-N.Y.), 



INTRODUCTION 



The continuing national controversy over 
standardized testing affects American education 
. from elementary schools to institutions of higher 
education and confronts educators, school 
officials and others with difficult questions. 
For nearly two decades many educators and much 
of the public have been concerned and alarmed by 
reports of declining college admissions test 
scores. Broad media attention to declining^ " 
college admissions test scores has resulted in 
public concern and demand for immediate remedies 
for what many perceive to be a decline in educa- 
tional quality throughout the natiojn. 

With the recent emphasis on baWic educa- 
tional skills and the tightening o£<| academic 
standards, many persons have been hpping for a^ 
reversal in declining standardized ^college ad- 
missions examination scores. How|^er» scores 
on the Scholastic Aptitude Test (SAT), taken 
^ by one-third of the nation's three mUHon high 
chool seniors, dropped to record low levels in 

19ftO, continuing a trend that begafn more than 

t 

15 years ago. [69:3; 6.2:4; 289.1}* This de- 

I 

ciine hrfs been viewed by some is evidence of 
deterioratfoii of the nation's secondary schools 
arid has helped apark Nationwide campaigns to regu- 
late standardized testing. [J1:A3; 123:3] ^ 



The contiaued test score decline has stim- 
ulated serious debate over whether the $AT is 
an appropriate measure of educational quality, 
whether ether measures can better indicate 
intellectual readiness for academic jJ'^j^and 
predict college potential, whether the SAT 
discriminates against minority stuAnts and 
perpetuates a class sy tem "in the guise of 
merit," and whether the test makers are account- 
able to the public. [187:58G-64GE; 188:219] 
^TTT5^ purposes of this ERS Report are to 
assemble facts about recent trends in college 
admission testing among secondary school stu- 
dents, collect information and opinions re- 
garding the reasons for declining college ad- 
missions test scores » and summarize sugges- 
tions for imp*.'oving» test" scores. In addition, 
important issues affecting college admissions 
are examined. Included are summaries of 
the debate between Ralph Nader and che Edu- 
cational Testing Service (ETS), the effects 
of coaching in preparation for the SAT, and 
the background of truth-in-testing legisla- 
tion. Statements from college admissions 
personnel on the use of test scores are also 
provided to give an overview of the college 
admissions process. 



^Bibliographic referenaea cited in this text are rioted by numbers within brackf^ts. Tlie nimber 
before the colon indicates the entry number within the reference section betjinHvn<j on paje l-^^; the 
nWTiber follouing the colon indicates the page(s) within the entry. Where no colon appears the "ita- 
tion refere to the entire entity. Multiple citations are separated by semicolons . 
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TRENDS IN COLLEGE ADMISSIONS TEST SCORES 



Secondary schools across the nation are un- 
der fire to reverse the test score decline that 
is well into its second decade. [168:Eii] In 
particular, attention has centered on the Scho- 
lastic Aptitude Test and the American College 
Testing Progiam (ACT). The SAT and ACT are 
standardized college admissions tests^^esigned 
to measure a candidate's developed mental abil- 
ities and potential pet form first-year college 
work. These tests are intended to supplement 
the candidate's academic record and accomplish- 
ments. (19:15; 17:1, 3] Since the quality of 
the high school curricula and standards in grad- 
ing practices vary considerably mong the nation's 
high schools, standardized admissions tests such 
as the SAT and ACT are used to provide a "common 
currency** th^'it allocs admissions officers and 
counselors to pl^.re itudents on tb'^ same footing 
regardless of social Strata and geographic loca- 
tion. [69:2-3] Colleges differ, however, in the 
weight given to admissions test scores in the 
selection of freshmen. Many private four-y^ar 
colleges consider test scores a very important 
factor in the admissions process, while many two- 
year colleges do not require them. [44:4] 

Orlcins of the College Board's 
Admissions Examinations 

In an attempt to introduce order into tha 
transition from high school to college, the Col- 
lege Entrance Examination Board (CEEB) was 

o 
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organized at Columbia University in November 
1900. The first CEEB admissions tests were es- 
say examinations designed by well-known scholars. 
In 1901, 973 candidates wrote essays i. history, 
Greek, Latin, German, French, English, mathema- 
tics, chemistr-, and physics. In 1926, Carl 
Campbell Brigham, a Princeton University psychol- 
ogist, introduced the more familiar multiple- 
choice SAT. The original multiple-choice SAT, 
administered to 8,040 candidates, consisted of 
nine subtests: paragraph reading, logical in- 
ference, analogies, definitions, artificial 
language, antonyms, arithmetical problems, 
classification, and number series. Three years 
later Brigham divided the SAT into two separate 
sections measuring verbal and mathematical apti- 
tude . During the 1930s CEEB concentrated on im- 
proving the consistency of i operations and 
strengthening the technical aspects of test con- 
struction. The increasing numbers of candidates 
taki.ig the SAT prompted CEEB to provide a means 
of comparing SAT scores among the different stand- 
ardized test forms. In April 1941, the group of 
1 \654 high school seniors tested became the 
standardization group for all subsequent forms 
of the SAT. Since then, SAT scores have been 
equated directly to preceding test forms and in- 
directly to the Aoril 1941 standardized form. 
This procedure, according to CEEB, insures that 
teat scores have the sa:ik? meaning from year to 
year and that the scoring represents the same 
level of ability regardless of the group tested, 

1 ^ 
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the difficulty of the test, or the time of ye^r 
tested. [19:1-3, 32] 

The SAT Is designed to raeasure verbal and 
mathematical reasoning abilities on a standard- 
ized score scale ranging from 200 to 800. A 
score of 200 represents the lowest score reported, 
while a score of 800 represents the bighe-t score 
reported. Thus, the 500-point merely marks the 
midway between the tVo end points of the scale. 
In April 1941 the mean score and standard devia- 
tion of the initial standardization group were 
500 and 100, respectively. These scores, how- 
ever, do not represent the mem score and stand- 
ard deviation of all high school seniors or of 
all college freshmen who have since taken the 
SAT. [19:11] Since the SAT candidate group is 
self-selected and does not represent all high 
school seniors who plan to attend college, spe- 
cial norm studies were conducted in 1960, 1966, 
and 1974 to obtain representative norm data on 
all high school seniors. [19:81-82; 6:15-16] 
As shown in Table 1, the mean norm SAT 
score for the national high school sample is 
368 for the verbal section and 402 for the mathe- 
matical section. Norms tor college-bound sejiiors 
are 61 points higher on the verbal section and 66 
points higher on the mathematical section. For 
the math section alone, mp'- ^h'd national high 
school sample averaged 2'. . ^ligher than 

women In the national sample; of college-bound 
seniors, mea averaged 50 points higher than 
women. 

Admissions Test Scores 

SchotasliC Aptitude T«»t.— Kach year approxi- 
mately one million high school seniors seeking 
admission to college take the SAT. While the 
College Entrance Examination Board located in 
New York City determines the policies and is 
'•esponsible for the SA:, the Educational Testing 
Service ^ Princeton, New Jersey, develops and 
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admiinster^> the tests, reports and analyzes the 
Ll'sI ^LOfL-,, conducts educational research, and 
gives instructional and advisory services in 
measurement and testing, both nationwide and 
abroad. [6.2:4; 69:5] 

Today the SAT is a 2^2 hour multiple-choice 
test consisting of two 30-minute verbal sections 
with a total oi 85 questions; two 30-minute mathe- 
matical sections with a total of 60 questions; 
and one 30-rainute experimental section consist- 
ing of questions used to equate new editions of 
the test to old versions and to improve test 
quality. The two verbal sections (SAT-V) con- 
tain antonym questions to test the extent of a 
candidate's vocabulary, analogy questions to 
test the ability to recognize a relationship in 
a pair of words, sentence completion questions 
to test the ability to recognize relationships 
among the parts of a sentence, and reading pas- 
sages to test interpretive and analytical skills. 
The antonym and analogy questions comprise the 
vocabulary subscore and the sentence completion 
and reading passage questions comprise the read- 
ing subscore. The inathemat leal section (SAT-M) 
includes arithmetic, algeb'-a, and geometry in 
two formats: 40 standard multiple-choice ques- 
tions and 20 quantitative comparisons. [6.1:4, 
8-9] 

In 1962-63, test scores climbed to a peak 
SAT-V average of 478 and a peak SAT-M average 
of 502. Since then^ both score averages have 
dropped substantially, especially in the verbal 
section. [297:6] In response to the unprece- 
dented decline in test scores, S. P. Marland, 
Jr., then president of the College Board, ap- 
pointed a '*blue-rihbon" Advisory Panel in 1975 
to investigate Lhe test score decline and inter- 
related issues. Willard Wirtz, former Secretary 
of Lr.bor, chaired the .vs?enty-one member Advisory 
Panel on the Scholastic Aptitude Test Score 
Decline. The Panel's summary report. On Fuv^ 
thcr Exanimtiori, was released in 19 77. As 
the Advisory Panel investigated possible reasons 

f ^ 
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TABLE 1 .—Percentile Ranks of SAT Scores 



Score 



For national high school sample and 
for college-bound seniors* 



For men and women separately on 
the mathematical sections 



Verbal 



Mathematical 



Men 



Women 



National 
hj-"i 
school 
sample 



Co lie ge- 

bound 

seniors 



National 
high 
school 
sample 



College- 
bound 
seniors 



Score 



National 


College- 


National 


College- 


high 


bound 


high 


bound 


school 


seniors 


school 


seniors 


sample 




sample 




99+ 


99 + 


99+ 


99+ 


99+ 


98 


99+ 


99+ 


99 


95 


99 


99 


96 


88 


98 


96 


92 


78 


96 


90 


85 


66 


91 


81 


75 


50 


84 


68 


64 


36 


73 


52 


52 


23 


61 


36 


38 


13 


^6 


;i 


20 


5 


25 


8 


4 


1 


6 


1 



800 
750 
700 
650 
600 
550 
500 
450 
400 
350 
300 
250 
200 



Mean 



Standard 
deviation 



99+ 

99+ 

99+ 

99 

97 

93 

86 

76 

64 

49 

33 

17 



99+ 
99+ 
99 
97 
92 
85 
73 
57 
40 
24 
11 
4 



99+ 
99+ 
99 
98 
94 
88 
80 
69 
56 
41 
23 
5 



99+ 

99 

97 

92 

84 

74 

59 

44 

30 

17 

6 

1 



800 
750 
700 
650 
600 
550 
500 
450 
400 
350 
300 
250 
200 



368 



429 



402 



468 



Mean 



416 



494 



390 



444 



111 



110 



112 



118 



Standard 
deviation 



117 



121 



104 



110 



♦Percentile ranks for the national high school sample are based on the scores earned by a representative sample of high 
school students who took the test at a special administration in October 1974. Students in this sample were selected regardless 
of course of study or intention to enroll in college. Percentile ranks for college-bound niors are based on the most recent 
scores earned by students in the 1978 graduating class who took the SAT at any time while in high school. The percentile ranks 
for the SAT-Verbal and SAT-Mathema tica 1 scores are found on ATP reports, while the percentile ranks of SAT ^Mathemat ical scores 
for men and women separately are not used on ATP reports. (Empfaasis in the original) 

SOURCE: Admissions Testing Program of the College Board. ATF Guide for High Schools and Colleger IJ79-hU Princeton, N.J.: 
College Entrance Examination Board, 1979, 1980, pp. 15-16. Copyright 1979, 1980 by College Entrance Kxa.nniat ion 
Board. Used with permission. 
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TABLE 2. --SAT Score Averages for College-Bound Seniors, 1967-1980* 







Verbal 


Section 






Testing Year 


Male 


Female 


Total 


^Xnnual Raw 
Score Change 


Annual Percent 
Change 



1967 
1968 
1969 
1970 
1971 
1972 
1973 
1974 
1975 
1976 
1977 
1978 
1^79 
1980 



463 
464 
459 
459 
454 
454 
446 
447 
437 
433 
431 
433 
431 
428 



468 
466 
466 
461 
457 
452 
443 
442 
431 
430 
427 
425 
423 
420 



466 
466 
463 
460 
455 
453 
445 
444 
434 
431 
429 
429 
427 
424 



0 
-3 
-3 
-5 
-2 
-8 
-1 
-10 
-3 
-2 
0 
-2 
-3 



Mathematical Section 



-0 

-0, 
-1, 

-1. 

-0. 
-2. 
-0. 
-0. 



-0.5 
-0. 7 



Testing Year 


Male 


Female 


Total 


Annual Raw 
Score Change 


Annual Percent 
Change 


196 7 


514 


46 7 


492 






1968 


512 


4 70 


492 


0 




1969 


513 


4 70 


493 


+1 




1970 


509 


465 


488 


-5 


-1.0 


1971 


507 


466 


488 


0 


1972 


505 


461 


484 


-4 


-0.8 
-0.6 
-0.2 
-1.7 


1973 


502 


460 


481 


-3 


1974 


501 


459 


480 


-1 


1975 


495 


449 


4 72 


-8 


1976 


497 


447 


472 


0 




1977 


497 


445 


4 70 


-2 


-0.4 
-0.4 
-0.2 
-0.2 


1978 


494 


444 


468 


-2 


1979 


493 


443 


467 


«1 


1980 


491 


443 


466 


-1 


* 



The averages for 1967 through 1971 are estimates of the averages that would have been reported 
for college-bound seniors of those years if such reports had been produced. 



SOURCE: 



Admissions Testing Program of the College Board. Mtioml College-Bound Seniors, 1980. 
New York. NY: CEEB. 1980. p. 5. Copyright 1980 by College Entrance Examination Board. 
Used with permission. 



for the decline in SAT scores, the SAT verbal 
and mathematical test scores continued their 
. downward apiral. 

Table ? lists the national SAT-V and SAT-M 
Hcore averages for male and female college-bound 
seniors from 1967 to 1980. During this period, 
average SAT-V scores have declined 42 points for 

ERLC 



all college-bound seniors, 35 points for males, 
and 48 points for females. Average SAT-M scores 
have fallen 26 points for all college-bound sen- 
iors. 2^ points inr males, and 24 points for 
females . 

Since 1976 the mean SAT-V score average for 
cpllege-bound seniors had declined seven points, 
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FIGURE 1.-SAT Verbal Score Averages for College-Bound Seniors, 1967-1980* 




20cl— L_l I I 1 i \ I \ 1 \ ^ 1 

1967 1968 1970 1972 1974 1976 1978 1980 

Year 



*The averages for 1967 through 1971 are estimates of the averages that would 
have been reported for college-bound seniors of those years if such reports had 
been produced. Each of the 85 SAT-V questions is worth approximately seven test 
points on the College Board's 200-to-800 point scale. 



SOURCE* Admissions Testing Program of the College Board. National Col lege- Bound 
Seniors, 1980. New York, NY: CEEB, 1980, p. 5. Copyright 1980 by 
College Entrance Examination Board. Used with permission. 



from 431 to 424. The mean SAT-M score average 
has declined six points, from 472 to 466. Be- 
tween 19 76 and 19 7 7 both SAT-V and SAT-M score 
averages declined two points. From 1977 to 1978 
SAT-V score averages stabilized at 429. This 
temporary leveling off was the first positive 
sign In SAT-V scores since 1968. During the 
19 77-78 period, however, the SAT-M score averages 
declined two points, from 470 to 468. Between 
1978 and 1979 the verbal score average declined 
two points, and the mathematical score average, 
one point. In 1980 the verbal score average de~ 
cllned three points, to 424, and the mathematical 
score average declined one ^/oint to 466. Thus, 
the 1980 SAT score averages represent the lowest 
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recorded levels on the SAT. [6.2:5] CEEB char- 
acterized the most recent declines as disappoint- 
ing in light of "efforts by many schools to im- 
prove education." [289.1:4] 

• The SAT-V score average of males fluctuated 
between 433* and 431 between 1976 and 1979. In 
1980 the SAT-V score average of males declined 
three points from 431 to 428. Since 1976, fe- 
males* verbal score average has declined con- 
sistently from 430 to 420. Between 1976 and 19''7 
the SAlr-M score average of males stabllzed at 497, 
and then declined three points in 1978. ITie fol- 
lowing year the SAT-M score average of males de- 
clined another point. In 1980 the score average 
of males declined two additional points to 491. 
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FIGURE 2.-SAT Mathematical Score Averages for College-Bound Sentors, 1967 1980* 



800 



r 



520 



500 



480 



460 



440 



420-*- 
20oI 



- — - Males 
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— . Total 




J 



1967 1968 



1970 



1972 



1974 



1976 



1978 



1980 



Year 



""The averages for 1967 through 1971 are estimates of the averages that would have been 
reported for college-bound seniors of those years if such reports had been produced. Each of 
the 60 SAT M questions is worth approximately mne test points on the College Board's 200-to-800 
point scale. 



SOURCE* Admissions Testing Program of the College Board. National College Bound 
Seniors, 1980. New York, NY; CEEB, 1980, p. 5. Copyright 1980 by 
College Entrance Examination Board. Used with permission. 



From 1976 to 1979 the SAT-M score average of fe- 
males showed an annual decline of one point. In 
198G the score average of females stabilized at 
443. (6.2:51 

Table 2 also shows that between 1968 and 
1972 score averages for college-bound seniors 
declinet' continually on the SAT-V and fluctu- 
ated on rhe SAT-M. Between 1973 and 1975 the 
decreases in both SAT tests became more acute. 
Since 1976 SAT score averages have continued to 
decline, but at a lesser rate than in the early 
19709. 

The downward trend exhibited by the SAT~V 
score averages for college-bound seniors from 
\BV to 1980 is indicated in Figure 1. The 
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trend on the SAT-M section is shown in Figure 2. 

Table 3 shows the approximate values of 
the individual ATP tests, the number of test 
questions on each test, and "he range of their 
score scales. According to ETS, the 85 SAT-V 
test items are worth approximately seven points 
each and the 60 SAT-M test items are worth ap- 
proximately nine points each on the College 
Board's 200-to-COO point scale. These point 
values vary slightly depending on the difficulty 
and length of tht test items. Between 1967 and 
1980 the combined score averages for males and 
females on the SAT-V declined 42 points (an av- 
erage annual decrease of 3,23 test p6ints). Ap- 
plying ETS's estimated value of seven points for 

» ') 
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TABLE 3. — Score Scales, Number of Test Questions and Appioximate Incremental 
Values in Scaled Score* for Questions Answered Correctly on the 
Scholastic Aptitude Test (SAT), Preliminary Scholastic 
Aptitude Test/National Merit Scholarship Qualifying 
Test (PSAT/NMSQT) , Test of Standard Written English 
(TSWE), and Achievement Tests, "1980 



Number of Test Approximate 
Individual ATP Test Score Scale Questions Values 



1. 


S$T-Verbal 


200-800 


8^ 


7 


2. 


SAT-Mathematical 


200-800 


bO 


9 


3. 


PSAT-Verbal 


20-80 


65 


0 


4. 


PSAT-Mathematical 


20-80 


50 


1 


5. 


TSWE 


20-80 
Maximum score 
reported is 60+ 


50 


1 


6. 


English Composition 


200-800' 


95 on old forms; 90 on new 
forms; 70 when the £CT has 
an essay component 


6 


7. 


Literature 


200-800 


60 


9 


8. 


American History and 










Social Studies 


200-800 


100 


6 


9. 


European History and 










World Cultures 


200-800 


100 


6 


10. 


Mathematics Level I 


200-800 


50 


10 


11. 


Mathematics Level II 


200-800 


50 


9 


12. 


Biology 


200-800 


100 


6 


13. 


Chemistry 


200-800 


90 


6 


14. 


Physics 


200-800 


75 


6 


15. 


French 


200-800 


85 


6 


16. 


Spanish 


200-800 


85 


5 


17. 


German 


200-800 


80 


6 


18. 


Latin 


200-800 


75 


6 


19. 


Hebrew 


200-800 


90 


4 


20. 


Russian 


200-800 


80 


6 



♦Approximate incremental ^'alue in scaled score contributed by each question answered correctly. Four 
deciioal values are used in the actual conversion of raw scores to the College Board Scale. Estimated In- 
cremental values may vary slightly from one form of the test to another because of the differences in test 
difficulty, length of reading passages, or occasiotial variations in the number of test questions. 

SOURCE: Information used by permission of Educational Testing Service, Princeton, N J , December 1980. 



each SAT-V test item indicates that 1980 tejt 
takers answered approximately six fewejr verbal 
test items correctly cv.mpared to their counter- 
parts In 1967. This represents an average annual 
decrease of 0.46 SAT-V test Items; that is, every 
two years the average SAT taker missed one addi- 
tional verbal test question. 

Between 1967 and 1980 combined score aver- 
ages for males and females on the SAT-M declined 
26 poipts (an average annual decrease of 2.00 
test points). Likewise, applying ETS*a estimated 
value of nine points for each SAT-M test item 

o 
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shows that, in 1980, SAT test takers answered 2.88 
fewer mathematical test items correctly compared 
to the average 1967 test taker. Tills represents 
an average annual decrease of 0.22 SAT-M test 
items. Thus, every four years the average SAT 
taker missed one extra mathematical test question. 

The combined total SAT-V and SAT-M score 
averages for males and females declin^'d 68 
points between 1967 and 1980. This is equal to 
an average annual decline of about 5.23 test 
points. At approximately eight points per ques- 
tion, this means thac 1980 SAT test takers 
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answered approximately 8.50 fewer test Items cor- 
rectly on a 145-question exam compared to L967 
SAT test takers. Over the 13-year period, this 
corresponds to a total decrease of two-thirds 
of a test item each year for the average SAT 
test taker. 

Since 1976 the number of seniors with SAT 
scores above 600 has decreased from eight per- 
cent to seven percent on the verbal section and 
from 17 percent to 15 percent on the matheniati- 
cal section. The number of candidates scoring 
In the middle range, between ^00 and 600, has 
declinec* two percent on the, verbal section to 
50 percent and declined one percent to 54 per- 
cent on the mathematical section. By 1980 the 
number of students scoring below 400 increased 
two percent in the verbal section, to 42 percent, 
and increased one percent in the mathematical 
section, to 30 percent. [10:14; 6.2:12] 

Traditionally, more male candidates than 
female candidates have taken the SAT. The 1974- 
75 academic year marked the first time that the 
number of females exceeded males. In 1980, for 
the sixth consecutive year, the percentage of 
female tent takers exceeded males, 51.8 percent 
to 48.2 percent. [10:5; 6.2:4] 

According to the College Board, the scores 
of two individuals on the same SAT must differ 
by more than 1.5 times the standard error of the 
difference to ensure that the higher score indi- 
cates greater ability and is not the result of 
measurement error alone. Latest data for the 
SAT (Form 3, administered In May 1978) ws 
that the standard error of the difference for 
the SAT-V is 43, and for the SAT-M, 46. [6:10] 
TMs means that two SAT-V scores would have to 
differ by more than 65 points (43 x 1.5) and 
two SAT-M scores would have to differ by more 
than 69 points (46 x 1.5) for one to be sure 
that "there is a genuine difference ir the abil- 
ities* being roaasured.** [6:11] Differences in 
t^at scores of two individuals of less than 1.5 
tines the standard error of the difference 
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should riot be considered significant, the Col- 
" lege Board states. 

Student D«tcrlptlva Qu98tionn«ire , — Each year stu- 
dents who take the SAT are asked to complete the 
Student Descriptive Questionnaire (SDQ) which in- 
cludes questions about the candidate's background, 
academic accomplishments, extracurricula activi- 
ties, ethnic group, family income, and intended 
area of college study. The voluntary response 
rate of the SDQ has risen from 77 percent in 1976 
to 91 percent In 1980, thereby providing a nearly 
complete profile of about two-thirds of all high 
school graduates who go immediately to college. 
[6.2:4] A comparison of the responses of the 
high school seniors on the 1976 and 1980 SDQs in- 
dicates the following trends: 

• The percentage of students who Identified 
themselves as belonging to an ethnic mi- 
nority rose from 15 percent in 1976 to an 
all-time high of 18 percent in 1980. 
Women comprised 55 percent of all minority 
students. [10:5; 6.2:7] Recently released 
data (1980) comparing the test score aver- 
ages of 350,000 whites, 31,000 blacks, and 
5,500 Chicanos who took the SAT between 
1972-73 and 1976-77 indicated that whites 
averaged 455 on the SAT-V and 493 on the 
SAT-M. In contrast, Chicanos* averages 
were 80 SAT-V points and 81 SAT-M points 
lower than whites, while blacks' averages 
were 119 SAT-V points and 134 SAT-M points 
lower than whites. In testimony before 
the House of Representatives Subcommittee 
on the Civil Service, Winton H. Manning, 
a senior vice-president of ETS, stated 
that differences in test scores among 
ethnic groups should "come as no surprise 
to anyone familiar with the historically 
unequal education available to blacks as 
compared with whites or with correspond- 
ing differences in social, economic, and 

o : 
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occupational spheres of \mLri<.an i 1 1 1. . " 
[135:5] 

• Between 1976 and 1980 the median i ax'^ntal 
contribution to the costs of education 
declined, from $1,170 to $920. The abil- 
ity of families to contribute financially 
varied considerably among ethnic groups. 
Since 1976 the median contribution of 
whites declined from $1,380 to $1,160; 
for Orientals, from $860 to $520; for 
American Indians, from $570 to $440; for 
Mexican Americans, from $210 to $50; for 
Puerto Ricans, from $200 to $0; and for 
blacks, from $100 to $0. About half of 
Puerto Rican and black families could 
not make financial contributions, while 
the other half could make some contribu- 
tion* The College Board also reported 

in 1980 that 21 percent o^ families coulu 
pay for the entire annual costs of educa- 
tion at a public four-year college (aver- 
aging $3,409), while 11 percent of fami- 
lies could afford the average annual cost 
of a private four-year college ($6,082). 
[10:6; 6.2:8] 

• The percentage of seniors indicating that 
they planned to seek part- time work in 
college to help finance their education 
declined from 43 percent in 19 76 to 3S 
percent in 1980. [10:6; 6.2:9] 

• For the fourth coasecutive year, the es^ 
timated grade point average (GPA) for 
males and females coad)jned declined from 
3\l2 to 3.06 on a f our-point^;9cale . In 
1980 males reported CPAs of 3.00 compared 
to 3.05 in 1976; females reported CPAs ot 
3.12 compared to 3.18. During this pe- 
riod, the percentage of students who in- 
.ticated that they had taken advanced or 
honors courses in English declined by 
one percent ( lo 14 percent), and in math- 
eaiatics by two percent (to 14 percent). 
[10:6; 6.2:6-7] 
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• in 1980, 71 percent of the seniors re- 
ported themselves to be in the top two- 
fifths of their '^v' jri scuool tUicc com- 
pared to 75 percenc in 1976. Almost 

all the other seniors reported themselves 
to be in the middle fifth m both \edrs. 
[10:6; 6.2:7] 

• Since 1976 the gap between the percent- 
age of men and women asi'trlnj to.^'j.pl a 
profpssional dc^jrec has narrowed. By 
1980 the percentage of women reporting 
plans to study for a professional degree 
rose from 15 percent to 16 percent, while 
the percentage of men declined from 24 
percent to 20 percent. [10:9; 6.2:8-9] 

• The 1980 seniors indicated that their 
most popular area of intoidtjd studij was 
business and commerce, up from 12.6 per- 
cent in 1976 to 18.6 perce-*- in 1980. 
Interest in health and medicine declined 
slightly to second place, from 17.9 per- 
cent to 14.7 percent. Engineering reg- 
istered gains from 8.4 percent to li.l 
percent, and the social sciences, from 
6.8 perce.iC to 7.8 percent. Continuing 
a trend that began in 1973, interest In 
education declined from 8.7 percent to 
6.1 percent. [10:10; 6.2:9] 

Test of Standard Written English. — The Test of 

Standard Written English (TSWE) n administered 
with the SAT. The 30-minute TSWE contains 50 
multiple-choice questions designed to evaluate 
a candidate's ability to recognize the basic 
principles of grammar, usage, diction, punctua- 
tion, and effectiveness of expression. [6.1:9] 
The TSWE has 35 usage questions and 15 sentence 
correction questions. (11:16J Scores are re- 
ported on a 20-to-80 scale, v^hich corresponds 
to the SAT scale of 200 to 800. Since the TSWE 
is intended only to assist college admissions 
personnel in placing students in appropriate 
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FIGURE 3.-Testof Standard Written Eng!i:,h Averages by Sex, 1975-1980* 
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•Each of the 50 TSWE questions is worth approximately 1,0 on the College 
8oard's scale of 20 to 80. 



SOURCE: Admissions Testing Program of the College Board. National Col lege- Bound 
Semors, 1980. Mew York, NY: CEE8, 1980, p. 5. Copyright 1980 by 
College Entrance Examination Board. Used with oermission. 



freshmen Cnglish courses, the scale has been trui»- 
Icated at 60-h. [10:7-8; 6.2:5^ ^ . 

Although males have had higher average scores 
on the"SAT-V since 1972 and on the SAT-M sine* 
1967, femaleis have had higher average scores on 
the TSWE since its intxoduction in 1975. Between 
1975 and 1980, the average score of women on the 
•TSWE declined from ^4.3 to 43.0. (See Figure 3.) 
During the same period, the average score of rren 
declined from 42.2 to 41.7. The average score 
for both sexes combined has declined from 43.2 
to 42.4, a decrease of 0.8 test points. [10:8; 
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9:7; 8:6; 7:5-6; 6.2:5-6] According to ETS, 
the 50 test questions are worth approximately 
1.0 point.- each. Thus, the d^ctease-^of 0.8 
points for both sexes combined durirtg the last 
five years corresponds to. slightly less than 
one test question. 

rhe standard error of the difference for 
the TSWE administered in May 1978 (Form 3) was 
3.7, Therefore, test score differences of less 
than 7.8 (5.2 x 1.5) should not be considered 
significant when comparing the scores of two in- 
dividuals on the TSWE. [6:10] 



TABLE 4.— Achievement Test Score Averages, 1972-1980 



1972 1973 1974 1975 1976 1977 1978 1979 1980 



Average for All 



Achievetnent Tests 


526 


527 


533 


5 31 


538 ' 


533 


J -J A. 


529 


J ji. 


American History/ 




















Social Studies 


492 


498 ' 


498 


494 


493 


492 


496 


480 




Biology 


535 


532 


545 


544 


543 


543 


544 


547 


551 


Chemistry 


568 


572 


581 


569 


567 


574 


577 


575 


573 


English Composition 


516 


517 


517 


515 


532 


516 


512 


514 


518 


European History/ 




















World Cultures 


n/a 


n/a 


n/ a 


521 


531 


526 


507 


516 


539 


French 


5 39 


544 


560 


553 


553 


553 


552 


554 


550 


German 


n/a 


n/a 


n/ a 


547 


55^ 


551 


553 


550 


552 


Hebrew 


n/ a 


n/a 


n/a 


577 


579 


581 


589 


588 


600 


Latin 


n/f» 


n/a 


n/a 


514 


524 


517 


508 


524 


5 29 


Literature 


n/a 


n/a 


n/ a 


522 


525 


526 


521 


522 


524 


Mathematics Level I 


541 


537 


545 


545 


546 


547 


541 


537 


536 


Mathematics Level IT 


n/a 


n/a 


n/a 


660 , 


665 


666 


665 


657 


653 


Physics 


n/a 


n/a 


n/a 


601^. 


592 


593 


591 


580 


592 


Russian 


n/a 


n/a 


n/a 


540 


559 


575 


587 


613 


622 


Spanish 


530 


539 


560 


544 


547 


535 


544 


542 


524 



SOURCES: Admissions Testing Program of the College Board. College-Bound Senior's. New York, NY: CEEB, 197? (1977) , p. S;" 
1978 (1978), pp. i:-14; 297:/ (1979), pp. 13-14; 1980 (1980), pp. 13-14. Copyright 1977, 1978, 1979, 1980 by 
College Entrance Examination Board. Used with permission. 
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FIGURE 4.--Achievement Test Score Avepages, 1972-1980' English Composition, Literature. 

American History/Social Studies, and European Hiitory and World Cultures 
800 I : . 

-L • • • English Composjtion I 




20ol_ 1 1 I { 1 , I T 

^972 1974 1976 1978 1980 



Year 



SOURCtS: Admissions Testing Program of the College Board. College-Bound 
Seniors. New York, NY: CEEB, (1977), p. 8; ;S75 (1978) 
pp. 13-14; f979 (1979), pp. 13-14; 1980 (1980), pp. 13-14. 
Copyright 1977, 1978, 1979, 1980 by College Entrance Examination 
Board. Used with permission. 
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Achl«V«mMt iMtS.— With the exception of the 
English composition test, which has a 40-niinute 
multiple-choice section and a 20-mlnute essay on 
the December edition, the achievement tests are 
one-hour tests in 15 academic subjects. Some 
achievement test- scores are used in the admis- 
sions procers while others are used for placement 
and pjuidance. [6.1:4] Although irore than one 
million candidates take the SAT annually, fewer 
than on« in five took at least one achievement 
test in 1980. [6.2:11] Sj:udents who\ake the X 
achievement tests are characteristically o£^ 

, higher ability, according to the College^oard . 

. [6.2:6] Unlike the continuous decline in'SAT 
scorrs, Table A shows that the achievement tests 
present a mixed picture of score gains, declines, 
and stability. 
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Figure 4 indicates the trends In the English 
Composition, Litera\ure, American History/Social 
Studies, and European History and World Cu„uured 
achievement test scores from 1972 to 19dO. 

• Efigliah Composition: with the exception 
of an aberration U\ 19 76, test scores on 
the English Composition test appear to 
be stable. The 1980 average of 518 is 
two points higher than the 1972 average. 
There are 95 questions on the older edi- 
tions of the test, 90 on the newer, and 
70 when the essay Component is included. 
Each test question is worth approximately 
six points. A difference of less than 71 
points should' not be considered signifi- 
^ cant when comparing the test scores of 

two students. When the essay component 
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FIGURE 5.--Achievement Test Score Averages, 1972-1980 Math Level I, Math Level II, Biology, 
Chemistry, and Physics 
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is included, t<est scores of less than 
69 to 81 points are not considered 
significant . 

Literature: Literature test score > ex- 
periencev^ stnall fluctuations between 
1975 ani 1980. The^l9<iO average of 524 
is two points higher than the 1975 aver- 
«»ge. Each of the 60 questions is worth 
fipproxAiaC^y nine test points <^n the 
College Board^ 200-to-800 scale. Only 
when the scortsa^ two students Ufer 
by 80 points or more can it be assured 
that there t "e real differences in stu- 
dent abilities 

American History and Social Studips: 
Compared to the 1979 average, "he 1980 
American History and Social Studies test 



score increased 21 points to 501, its 
highest recorded level. Each of the 100 
test questions are worth approximately 
six points. When comparing the scores 
of students on this test, differences of 
fewer than 68 points are not considered 
significant. 
• ' European History and World Cultures: In 
1980 the European History and World Cul- 
tures test score average reached an all 
time hi^ of 539, up 23 points from the 
previous year. The point value of each 
of the 100 test questions is fixed at 
si3t points. Differences of less than 
66 points in the scores of two students 
on this test should not be considered 
significant. 
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Figure 5 indicates the trends in the Biology, 
Ch»'"istry, Mathematics Level I, fclathematics Level 
II, and Physics achievement test scores from 1972 
tc 1980. 

• BiolG'ju: In 1980, biology test scores 
averages increased for the third consecu- 
tive year. The 1980 average of 551 is 
the highest level recorded and is 16 
points above the 1972 average 535. 

The value for the 100 questions is fixed 
at six points. When comparing the f.est 
scores of two students, a difference of 
more than 63 points is necessary in order 
to determine that one student has greater 
ability than anothtir. 

• Chemistry: Although the chemistry test 
score average has declined for the second 
year in a row, the 1980 average of 57^ is 
six points higher than the 1976 average 
of 567. Each of the 90 questions has a 
fixed value of six points. Differences 
in test scores of more than 59 points are 
necessary to distinguish between the abil- 
ities of two students being measured by 
this test. 

• MathematioB Level I: Since 1977, test 
score averages on the Mathematics Level I 
test have declined 11 points from 547, 
the all-time high. Viewed from a longer 
perspective, the 1980 average is five 
points lower than the 1972 average of 541. 
Each of the. 50 Mathematics Level I ques- 
tions is fixed at 10 points. A difference 
of less than 75 points, when comparing 
two students' scores, is not considered 
signif icant . 

• Mathemitioe Level IT: For the third 
consecutive year, the Mathematics Level 
II test score average declineo. In 1930 
it reached its lowf»st recorded l^vel, 
653, but remains the highest average 
among all the achievement vt^tsts. Point 
values for each of the 50 questions 
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are fixed at. nine points. Only wlien test 
score averages exceed 72 points can one 
be iaure that there is a difference in the 
abilities of two students being tested. 

• Fhys-fcs: The 1980 physics test score 
average of 592 is 12 points higher than 
the 1979 verage, but nine pointy below 
the 1975 average of 601. Each of the 
75 questions has a value of six points. 
Test score differences between two stu- 
dents of more than 62 points are needed 
to be certain that there is a real dif- 
ference in student abilities. 

Figure 6 indicates the trends in the French, 
German, Hebrew, Latin, Russian, and Spanish 
achievement test scores from 1972 to 1980. 

• Freyiah: The 1980 average on the French 
test of 550 is four points below the 
1979 average, btit is 11 points higher 
than the 1972 average of 539. Each of 
the 85 French questions is worth approxi- 
mately six points. Differences in two 
students' scores of less than 60 points 
are not considered significant. 

• German: Test score averages in German 
have been relatively stable. Since the 
1976 average of 555, test scores have 
fluctuated five points. The 1930 aver- 
age is 552. Each of the 80 questions is 
worth approximately six points. Only 
when differences in students* test scores 
exceed 57 points can one be reasonably 
sure that the higher score indicates 
higher developed abilities. 

• Hebrew: With the exception of a decline 
of one test point in 19 79, the Hebrew 
test score average has climbed consist- 
ently in the last six years. The 1980 
average of 600 was the highest recorded 
level, 23 points more than the 1975 av- 
erage. Each of the 90 questions is 
worth approximately four points. A dif- 
ference of more than 42 points in the 
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FIGURE 6,-Achievement Test Score Averages, 1972-1980 French, German, Hebrew, Latin, 
Russian, and Spanish ^ 
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test scores of two students shows that 
the higher score r^ipresents greater abil- 
ities on this test. 

Latin: In 1980 the Latin test score av~ 
erage reached an all-time high of 529. 
Each of the 75 questions is worth approxi- 
mately six points. Differences of less 
than 77 points in the scores of two stu- 
dents being measured should not be con- 
sidered significant. 

Russian: Since 1975 Russian test score 
averages have clxm^^d substantially, lis- 
ing from 540 to 622, an increase of 82 
points. Each of the 80 qv.estlons is 
worth approximately six points. Only 
when Lest scores differ by more than 60 
points can one be sure that there a 
real difference in the abilities of two 



students being tested. 
• Spanish: Spanish test score averages 
were erratic during the 19 70s. Compared 
to the 1979 average, test scores declined 
sharply in 1980. This 18 point decline 
to 524 was their lowest recorded level. 
Each of the 85 questions is worth approxi- 
-^ately five points. A difference of fewer 
than 56 points in the scores of two stu- 
dent's on this test is not considered 
significant . 
The most popular subjects selected by candi- 
dates taking the achievement test series in 1980 
were the English composition test (184,714 stu- 
dents). Mathematics Level I test (146,172 stu- 
dents), and the American History and Social 
Studies test (55,987 students). The College 
Board reported that the most able candidates 
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selected the Mathematics Level II, physics, 
Latin, and chemistry tests; the least able candi- 
dates took the Spanish, literature, Mdthematics 
Level I, and American history tests. [6.2:6, 
13-14] 

Overall, the Mathematics Level I an^ Mathe- 
matics Level 11 test score averages heve exhibited 
a slight downward trend in the late 1970s and into 
1980. Test score averages in European history and 
world cultures, Spanish, and Latin have shown er- 
ratic trends. With the exception of a one year 
aberration, average<i on the English composition, 
American history and social studies, and physics 
teats appe«jr somewhat stable. Chemistrv, litera- 
ture, French, and German also appear stable. On 
the other hand, achievement test score averages in 
biology and Hebrew have shown upward movement 



in the late 1970s and into 1980, while Russian 
test scores have climbed dramatically. 

Table 5 provides a summary of the standard 
error of the difference for the 15 achievement 
tests. The College Board cautions both high 
school counselors and college admissions officers 
against "making fine distinctions between scores. 
Differences in test scores of less than 1.5 times 
the standard error of the difference are not sig- 
nificanu when comparing the scores of two Individ 
uals on the same test. [6:11] 

Preliminary Scholastic Aptitude Test/National Merft 
Scholarship Qualifying Test. — since 1971 the 

College Entrance Examination Board and rhe Na- 
tional Merit Scholarship Corporation (NMSC) have 
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TABLE 5. --Reliability Characteristics of tLe College boardVs 
Achievement Tests 



Differences in ATP Test Scores 
Standard Error of tlie (Standard Error of the 



Individual ATP Test 


Difference 


Di f ference 


American History/ 






Social Studies 


45 


68 


Biology 


42 


d3 


Chemistry 


39 


59 


English Composition 


47 


71 


English Composition with 






Essay 


4o-54 


69-81 


European History and 






World Cultures 


44 


66 


French 


40 


60 


German 


38 


57 


Hebrew 


28 


42 


Latin 


51 


77 


Literature 


5J 


80 


Math Level I 


50 


75 


Math Level II 


48 


72 


Physics 


41 


62 


Russian 


40 


60 


Spanish 


37 


56 



SOURCE: Admissions Testing Program of the College Board. ATP Guide for High Scliools and 
Colleges 1979-81. New York, NY: CEEB, p. 11. Copyright 1979, 1980 by College 
Entrance Examination Board. Used with permission. 



Jointly sponsored the Preliminary Scholastic Ap- 
titude Test/National Merit Scholarship Qualifying 
Test (PSAT/NMSQT). The PSAT/NMSQT is used to aid 
guidance counselors in assessing students* compe- 
tency relevant to college admissions, identify 
high-scoring students for NMSC scholarships, and 
prepare Juniors for taking the SAT. The PSAT/NMSQT 
is a multiple-choice test constructed from re- 
tired forms of the SAT. [19:45; 56:6-8] It con- 
sists of 65 verbal questions and 50 mathematical 
questions, with each verbal question worth ap- 
proximately 0.9 points and each mathematical 
question approximately 1.0 points. Verbal and 
mathematical scores for the PSAT/NMSQT are re- 
ported on a 20-to-80 scale. Like the Test of 
Standard Written English, the PSAT/NMSQT scores 
correspond to the SAT scale of 200 to 800. Ju- 
iors and seniors can estimate rheir probable SAT 
scores by adding a zero to the PSAT/NMSQT score. 
For example, a PSAT verbal score of 4 5 corre- 



sponds to a SAT verbal score of 450. [55:7] 

Table 6 indicates the numbers, means, and 
standard deviations of verbal scores for Juniors 
testeu from 1959-60 to 1979-80. Between 1975-75 
and 1976-77 the mean PSAT-V scores of males and 
females combined declined 0.5 points, from 41.0 
to 40.5. In 1977-78 the verbal score declined 
0.6 points to 39.9, the lowest score ever re- 
corded. The verbal score rebounded by 0.7 
points, to 40.6, in 1978-/9, but fell 0.4 
points, to 40.2, in 1979-80. Over the recent 
four-year testing period, the PSAT-V score has 
fluctuated by 1.1 points, compared to a fluctua- 
tion of 3.4 points over the 20-year history of 
the test's administration. The most recent 
PSAT-V score of males and females combined in 
1979-80 is 1.0 points below the score of 41.2 
in 1959-60 and 1,2 points below the score of 
''^1.4 in 1970-71 
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TABLE 6. — Verbal Scores for Juniors on the Preliminary Scholastic Aptitude 
Test/National Merit Scholarship Qualifying Test 1959-60 to 1979-80* 



Numbers, Means, and Standard Deviations of Verbal Scores 
for Junior Students Tested from 1959-60 to 1979-80 



Male Feiftale Total 



Year 


Number 


Mean 


SD 


Number 


Mean 


SD 


Number 


,ean 


SD 


1959-60 


186, 791 


41.0 


11.2 


191,365 


41.3 


10.8 


378,156 


41.2 


11.0 


1960-61 


229,781 


40.9 


10.7 


232,008 


41.0 


10.4 


461,789 


40.9 


10.6 


1961-62 


253,001 


42.1 


10.7 


254,839 


42.6 


10.6 


507,839 


42.3 


10.7 


1962-63 


317,053 


42.8 


10.7 


330,624 


42.9 


10.5 


64 7,709 


42.9 


10.5 


1963-64 


379,282 


43.1 


JO. 8 


395,793 


43.4 


10.6 


775,075 


^3.3 


10.7 


1964-65 


402,465 


42.7 


10 .6 


421,496 


43.0 


10.4 


823,961 


42.9 


10.5 


1965-66 


447,808 


42.5 


11.0 


477,685 


42. C 


10.9 


926,035 


42.2 


10.9 


1966-6 7 


461,994 


42.7 


11.0 


496,478 


42.7 


10.7 


958,974 


42.7 


10.8 


1967-68 


493,831 


42.0 


10.8 


538,421 


^2.1 


10.7 


1.032,945 


42.0 


10.8 


1968-69 


508,888 


42.2 


11.5 


55:?, 304 


42.9 


11.6 


1,064,986 


42.6 


11.6 


1969-70 


507,570 


42.2 


10.8 


559,721 


42.2 


10.8 


1.067,834 


42.2 


10.8 


1970-71 


492,990 


41.4 


11.0 


553,583 


41.4 


10.7 


1,047,135 


41.4 


10.8 


1971-72 


512,622 


42.1 


10.6 


576,393 


42.4 


10.5 


1.090.868 


42.2 


10.6 


1972-73 


491,385 


s2.6 


11 .1 


564,975 


42.7 


10.9 


1.056.752 


42.7 


11.0 


197''-74 


492,683 


42.0 


10.8 


574,424 


41.7 


10.7 


1.067.601 


41.8 


10.8 


1974-75 


503,959 


42.2 


10.7 


589,840 


41.1 


10.4 


1.094.328 


41.6 


10.5 


1975-76 


508,834 


41.8 


11.1 


602,818 


40.4 


11.0 


1.112.483 


41.0 


11.1 


1976-77 


510,543 


40.9 


10.4 


609,174 


40.1 


10.3 


1.120,542 


40.5 


10.4 


1977-78 


521,802 


40.6 


10.6 


629,870 


39.3 


10.6 


1.152.494 


39.9 


10.6 


1978-79 


513,515 


41.2 


10.4 


622,212 


40.1 


10.3 


1.136.586 


40.6 


10.3 


1979-80 


510,115 


40.7 


10.3 


621,493 


39.9 


10.4 


1.132.370 


40.2 


10.4 



Preliminary Scholastic Aptitude Test. 1959-60 through 1970-71; Preliminary Scholastic 
Aptitude Test/National Merit Scholarship Qualifying Test from 1971-72 to 1979-80. 

SOURCE: College Entrance Examination Board. 



Table 7 shows the PSAT/NMSQT numbers, means, 
and standard deviations of li.athematical scores 
for Juniors tested from 1959-60 to 1979-80. The 
mean PSAT-M score for males and females combined 
was 45.5 in 19 75-76. It declined 0.5 points to 
45.0 in 1976-77 and 0.8 points to 44.2 in 1977- 
78. During the past two years, however, the 
PSAT-M has risen by 1.1 points to 45.3. Since 
1975-76 the mathematical score has fluctuated 
by 1.3 points, as compared to 2.7 points over 
the entire history of the PSAT*8 administration. 
The i979-80 PSAT-M mean of 45.3 is 0.3 points 
higher than the 195V-60 mean of 45.0. but 0.8 
points lower than the 1970-71 mean of 4r.l. 



Presented in Figure 7 is a graphical repre- 
sentation of the yearly fluctuations of the 
PSAT/NMSQT from 1959-60 to 1979-80 for males 
and females combined. Unlike the continuing 
decline in SAT scores, the PSAT scores for jun- 
iors shown in this graph have fallen much less 
and also less uniformly than scores on the SAT. 
In 1970-71. PSAT/NMSQT verbal scores for males 
and females combined were 41.4. They declined 
by 1.2 points, to 40.2. in 1979-80. This de- 
cline of 1.2 Is equivalent to one and one-third 
fewer test questions answered correctly by te^t 
takers during the 1970s Similarly, the 1970- 
71 PSAT/NMSQT math scores for males and females 
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TABI.K 7. — Mathematical Scores f^r Juniors on the Preliminary Scholastic 
Aptitude Test/Nationa. .rit Scholarship Qualifying Test 
1959-60 to 1979-80* 



Numbers, Means, and Standard Deviations of Mathematical Scores 
for Junior Students Tested from 1959-60 to 1979-80 



Male Female Total 



Year 


Number 


Mean 


SD 


Number 


Mean 


SD 


Number 


Mear 


SD 


1959-60 


186, 791 


47,6 


10.2 


191,365 


42.4 


8.6 


378,156 


45.0 


9,8 


1960-61 


229, 755 


47.5 


10.2 


2 31,956 


42,3 


9.2 


461,711 


44.8 


10.1 


1961-62 


252,995 


48.6 


10.4 


254,820 


43.6 


9.4 


507,804 


46.1 


10.2 


196 2-63 


317,069 


48.7 


10.6 


330,599 


44.3 


9.7 


647,668 


^;6.5 


10.4 


1963-64 


379,266 


47.6 


10.5 


395,793 


43.5 


9.3 


775,075 


45.6 


10.1 


1964-65 


402,465 


46.9 


10.9 


421,495 


42.6 


9.8 


823,961 


44.7 


10.6 


1965-66 


447,803 


48.3 


11.1 


477,678 


43.8 


10.2 


926,023 


45.9 


10.9 


1966-67 


461,936 


47.1 


11.5 


496,455 


43.1 


10.7 


958,943 


45.0 


11.3 


1967-68 


493,829 


46.4 


10.8 


538,418 


42.7 


9.7 


1,032,940 


44.5 


10.4 


1968-69 


508,858 


47.4 


11.5 


555,260 


44.0 


10.5 


1,064,912 


45.6 


11.1 


1969-70 


507,557 


47.0 


11.4 


559,714 


43.2 


10.6 


1,067,814 


45.0 


11.1 


1970-71 


492,982 


48.4 


11.5 


553,568 


44.1 


10.6 


1,047,112 


46.1 


11.2 


1971-72 


512,622 


47.3 


11.6 


576,393 


43.4 


10.5 


1,090,868 


45.2 


11.2 


1972-73 


491,294 


49.1 


11.4 


564,864 


45.0 


10.4 


1,056,550 


46.9 


11.1 


1973-74 


492,573 


47.8 


11.8 


574,256 


43.5 


10.9 


1,06 7,323 


45.5 


11.5 


1974-75 


503,790 


48.2 


11.2 


589,620 


43.9 


9.9 


1,093,938 


45.9 


10.7 


1975-76 


508,700 


47.9 


11.4 


602,631 


43.5 


10.4 


1,112,159 


45.5 


11.1 


1976-77 


510,435 


47.3 


11.5 


609,036 


43.0 


10.4 


1,120,298 


45.0 


11.1 


1977-78 


521,631 


46.5 


10.9 


629,669 


42.2 


9.8 


1,152,122 


44.2 


10.5 


1978-79 


513,382 


47.2 


11.5 


622,041 


42.9 


10.2 


1,136,281 


44.8 


11.0 


1979-80 


509,981 


47.5 


11.3 


621,338 


43.3 


10.2 


1,132,080 


45.3 


10.9 



* 

Preliminary Scholastic Aptitude Test, 1959-60 through 1970-71; Preliminary Scholastic 
Aptitude Test/National Merit Scholarship Qualifying Test from 1971-72 to 1979-80. 

SOURCE: College Entrance Examination Board. 



combined were 46.1, compared to 45.3 in 1979-80. 
The decline of 0.8 points is equal to approxi- 
mately four-fifths of a test question. Thus, 
the total decline in PSAT/NMSQT scores during 
the 1970s was slightly more than two test ques- 
tions out of a total of 115. 

American Coii«g« Tasting Program. — since its 

founding in 1959, the ACT has attempted to as- 
sess the general educational development of 
high school students and their ability to per- 
form college-level work. [16:3-4] More than 
900^000 students are tested annually in the 
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United States, Canada, and abroad. Some of the 
major purposes of the /.T Assessment Program 
are (1) to provide estimates of students^ aca- 
demic and out-of-class abilities; (2) to give 
admissions and guidance services to students 
and admissions personnel during the transition 
to posc-secondary education; (3) to furnish 
colleges with admissions/enrollment data; (4) 
to supply pre-college counseling; and (5) to 
assist in placing freshmen in appropriate sec- 
tions of introductory college courses in English, 
mathematics, social studies, and natural 
sciences. (3:4; 18:2] 

1 > 
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FIGURE 8,-Mean Scores from Test Section of ACT Assessment Program* Males, Females, and 
Males/Females Combined, 1969-70 to 1979-80* 



36.0 



^1 

JL — — — Males 

Males/Females Combined 

Females 



1 




l.oT L 



_L 



J. 



J 



1969- 
70 



1971- 
72 



1973- 1975- 
74 76 
Year 



1977- 
78 



1979- 
80 



*M«an scores compiled from data based on 10 percent sample of students who took the ACT Assessment's 
four subject area tests on national test dates each year. Only first four test dates each year were used from 
1969-70 through 197&<76. Since then, all five dates each year are used. 



SOURCES: The American College Testing Program. "ACT Assessr »ent Test Scores-3rd Year in Row for 
Increase/' Activity, 18 (May 1980), p. 4, and letter f om ACT (October 1980). Used with 
permission. 



One component of the ACT Assessment Program 
is s battery of four academic tests: English Us- 
age* Mathematics Usage, Social Studies Reading, 
and Natural Sciences Reading. Test Items require 
students to demonstrate reasoning abilities and 
problem solving skills, as well as knowledge In 
the four subject areas. Specifically, the 
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English Usage Test Is a 40-mlnute, 75-item test 

designed to measure students' understandlng^of 

the conventions of standard written English and 

the elements of expository writing: logic and 

organization, sentence structure, diction, style, 

grammar, and punctuation. The Mathematics Usage 

Test Is a 50-minute, 40-ltera test dediigned to 
9 4 
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measure mathematical reasoning ability. It em- 
phasizes tie solution of quantitative probloras. 
The Social studies Reading Test is a 35-rainute, 
52-iteB test designed to measure knowledge and 
problem solving skills required in social stud- 
ies. Some test items are based on reading pas- 
sages and require reading comprehension and the 
ability to make inferences and deductions; ex- 
amine interrelationships; recognize a writer's 
bias, style, and mode of reasoning; and draw 
conclusions. Other items test the ability to 
apply previously acquired knowledge to new situ- 
ations. The Natural Sciences Reading Test is a 
35-nlnute, 52-item test designed to measure 
knowledge and the ability to read, analyze, and 
evaluate natural science material. The passages 
cover a variety of scientific topics found in 
the high school curriculum. [18:3] 

Test scaled scores on the ACT range from a 
low of 1 to a high of 36, but the minimum Compos- 
ite score is 1 and the maximum Composite score is 
35. The standard error of measurement for each 
of the ACT tests is about 2 and for the Composite 
score, about 1. According to the ACT Assessment 
Program, an Lnglish Usage Test score cf 18 should 
fall within a range of 16 to 20, and a Composite 
score of 19 should fall within a range of 18 to 
20. [18:6] A Composite score below 14 indicates 
that a student has had "a restricted educational 
development background." Scores between 14 and 
19 are considered low average; between 19 and 
24, high average; and above 24, superior. [18:12] 
Since there is no penalty for guessing on the 
test, it is to the student's advantage to answer 
every question. [18:5] 

Table S and Figure 8 show the mean scores 
from the test section of the ACT Assessment Pro- 
gram '^rom 1969-70 to 1979-80. The data are based 
on a 10 percent sample of students f^om each 
year's national test dates, rather than on all 
students tested in a given year. This sample is 
considered to reflect better the college-bound 



students who participate in tho A(. r Asscssmcnl 
Program each year. [3:4] 

The ACT Assessment Program experiei.ced a 
decline in tost scores similar to the decline 
in SAT test scores in the early and mid-i970s. 
But between 1975-76 .:nd 1978-79, che ACT Compos- 
ite scores of males and females combined steadily 
increased, unlike SAT scores, rising from 18. J to 
18.6. This increase over a three-year period was 
noteworthy, according to the ACT, because only 
once since 1969-70 had there been an increase in 
the mean Composite score, which was an increase 
of one-tenth of a standard score point in 1972- 
73. [3:4] Most reLentls, the 1980 Composite 
score of males and females combined declined by 
one-tenth ot a standard score point to 18.5, the 
same level recorded in 1*^77-78. According to 
Richard l>. Fergusou, senior vice presidert of 
ACT Programs and Services, "small variations 
from one year to another are not at all uncommon. 
Only when they yield consistently lower or higher 
mean scores over an extended period of Lime are 
we able to determine the existence of a trend. "-^ 
[3:4] A Hiocussion of ACT subtest score movement 
in the 19/Os follows. 

• The Composite score of *vaLcs Increased 
from a low of 19.1 in 1975-7f^ to 19.3 
in 1977-78. It has remained unchanged 
at 19.3. The Composite score of fernales 
rose from 17.6 in 1975-76 to 11.^ in 
1976-77. It remained unchanged the fol- 
lowing year, rising to 17.9 in 1978-79, 
where it remained unchanged tTie tollow- 
ing year. 

• The Engliiih subtest score of males in- 
creased consistently from a low of 16.8 
in 1975-76 to 17.4 in 1977-78. It re- 
maint»d unchanged at 17.4 in 1978-79 be- 
fore declining to 17.3 in 19 79-80. The 
English subtest score of females increased 
steadily from a low of 18.0 in 1975-76 to 
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TABLE 8.— Mean 


Scores from 


Test Section of ACT 


Assessment Programs 










Social 


Natural 




Year 


English 


Math 


Studies 


Sciences 


Composite 






Males/Females Combined 








xo . ^ 


20 .0 


19 . 7 


20 .8 


19 .9 


1 070 — 71 


1 ft 0 

XO • \J 


19 .1 


10 . 7 


20 .5 


19.2 


1971-72 


17.9 


18 .8 


1 Q C 

10 .0 


20.6 


19.1 


1972-73 


18.1 


19 .1 


18 . 3 


20.8 


19.2 


1973-74 


17.9 


18 . 3 


lo . 1 


/U • 0 


1 ft Q 

10 .y 


1974-75 


17.7 


17.6 


1 / ,4 


21.1 


18.6 


1 Q7'>— 7A 


1 7 s 


17.5 


X / .U 


20.8 


18.3 


1 Q7fi— 77 


17 7 


17 ,4 


1 7 . J 


20.9 


18.4 


1 Q77-.7ft 


17,9 


17.5 


IT 1 
1 / . 1 


20,9 


18.5 


1 Q7ft— 7Q 


17 0 
X / . 7 


17.5 


17.2 


21.1 


18.6 




17 0 
X / . 7 


17.4 


17.2 


21.1 


18.5 








Males 






1 QAQ. 7n 


1 7 

X / » 0 


21.1 


20 . 3 y 


21.6 


20.3 


1 Q7n— 71 


17.1 


20.2 


19 ,0 


21.3 


19.5 


1971-72 


17.0 


20.1 


ly , 1 


n.6 


19.6 


1972-73 


17.3 


20 . 2 


19 .0 


a. 7 


19.7 


1973-74 


17.1 


19 .7 


ly .1 




10 7 
Ly . / 




17.1 


19 .3 


1 0 T 

lo . 7 


22.4 


19.5 


1 Q7^ — 7A 
Vy Ij /O 


1 ft ft 

xu . 0 


19 . 2 


IT Q 

X / ,y 


22.0 


19.1 


\.y iK}"^ 1 1 


1 7 0 


18 .9 


18 .2 


22. 3 


19.2 


1 Q77— 7ft 


17^ 


19.1 


lo .U 


22. 3 


19.3 


1 Q7fi.7Q 
X^ / 0— fy 


17^ 

X / . H 


19.1 


18.1 


22.3 


19.3 


X^ /^— OU 


17 

X / • J 


1 ft 0 

xO . 7 


1 ft 7 
X 0 . ^ 


22.4 


19.3 








Females 






1 Q£.Q 7n 

l^oy— /v 


10 A 
x^ . ^ 


18.8 


19.0 


20.0 


19 .4 


1 0 70—71 
X,y fyJ'^ /I 


1 Q 0 
X 7 . u 


18.0 


18.4 


19.7 


18.9 


1971-72 


18.7 


17.7 


18.2 


19.6 


18.7 


1972-73 


Id. 9 


18.0 


17.7 


19.9 


18.8 


19/3-74 


18.6 


17.1 


17.3 


19.6 


1 i.2 


1974-75 


18.3 


16.2 


16.4 


20.0 


17.8 


1975-76 


18.0 


16.0 


16.2 


19.7 


17.6 


1976-77 


18.2 


16.1 


16.5 


19.6 


17.8 


1977-78 


18.3 


16.2 


16.4 


19.8 


17.8 


1978-79 


18.4 


16.2 


16.4 


20.2 


17.9 


1979-80 


18.3 


16.2 


16.4 


20.0 


17.9 



-Mean scores compiled from data baaed on 10 percent sample of students who took the ACT 
Assessiwnt's four subject-area tests on national test dates each year. Only first four test 
dates each year were used from 1969-70 through 1975-76. Since then, all five dates each year 
are used. 



SOURCE: The American College Testing Program. "ACT Assessment Test Scores— 3rd Year in Row foi 
Increase/' Activity, 18 (May 1980), 4, and letter from ACT (October 1980). n 
Reprinted with permission. 
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18.4 in 1978-79. It declined one-tenth 
of a standard score point to '8.3 in 
1979-80. 

• The mathenati:*s subtest score of males 
declined three-tenths of a standard score 
point from 19.2 in 1975-76 to 18.9 in 

' ^^976-77. It increased to 19.1 in 1977-78 
and remained unchanged the following year. 
In 1979-80 the subtest score of males de- 
clined two-tenths of a standard score 
point to 18.9, the same level recorded in 

1976- 77. The mathematics subtest score 
of females increased consistently from 
16.0 in 1975-76 to 16.2 in 1977-78. It 
has remained unchanged. 

• The social studies subtest score of males 
Increased three-tenths of a ard 
score point from 17.9 in 1975-/0 to 18.2 
in 1976-77. It deriineH to 18.0 in 

1977- 78 and Incniased to 18.1 the next 
year. It rose to 15.2 in 1979-80. The 
social studies subtest score of females 
Increased three-tenths of a standard 
score point from 16.2 In 1975-76 to 16.5 
in 1976-77. It declined to 16.4 in 1977- 
78, where it has remained unchanged. 

• The natural sciences subtest score of 
males Increased from 22.0 In 1975-76 to 
22.3 in 1976-77, remaining unchanged 
through 1978-79. It increased one-tenth 
of a standard score point to 22.4 In 1979- 
80. The natural sciences subtest score ot 
females declined one-tenf.h of a standard 
s'.ore point from 19.7 In 1975-76 to 19.6 
in 1976-77. It increased to 19.8 in 
1977*78 and then by four-tenths of a 
standard score point, to 20.^, In 1978-79, 
its highest recorded level in the l*^70s. 
In 1979-80 It declined by two-tenths of a 
standard score point to 20.0. 

The most recent ACT national claaH profile 
norms were based on a 10 percent sample of ACT- 
tesCed students enrolled at 1,103 colleges In 
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1979-80. The norms, however, overrepre&ent ACT-' 
tested college-bound studer.Lb in the Midwest, 
South, Rocky Mountains, and Plaini> states and 
underrepresent college-bound students in the 
Northeast and Middle Atlantic states. Likewise, 
private colleges and universities are underrep- 
resented .n the sample. [15^i] 

• f'f the 46,606 students in the sample 
21,333 were males and 25,273 were females. 
[15:1] 

• The typical student in the 1979-80 sample 
had an ACT Composite score of 18.9 and a 
high school average of 3.0, compared to 
the national averages of 18.7 and 3.0, 
respectively, for 1978-79 entering 
freshmen. [15:1] 

• Students were primarily interested in 
the field of business- commerce for their 
planned educational major and first voca- 
tional choice. (15:1] 

• More students aspired to a bachelor's 
degree than to a graduate or professional 
degree, 44 percent to 39 percent. (15:1] 

• Regarding the racial composition of the 
sample, 75 percent identified themselves 
as Caucasian American; seven percent, 
Afro-Amoric .in/Blaek; two percent, Mexican 
/Vmerican/Chicano; one percent, American/ 
Alaskan Native; one percent. Oriental/ 
Pacific American; less than one perd:ent, 
Puerto Rlcan/Hispanic ; two percent, 
other; four percent preferred not to re- 
spond; and eight percent were not given. 
(15:L] 

• Students expressed a need for help in 
the following area? : 44 percent with 
educational and vocat ional plans ; 40^ 
percent vith mathematics; 37 percent 
with study skills; 32 percent with read- 
ing; 30 percent with personal counseling; 
and 27 percent with writing. [15:1] 

• A majority of the students, 55 percr-nt, 
expressed a need for assistance in find- 
ing a school-year job. [15:1] 
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WHY THE TRENDS IN TEST SCORES 



Wtt-H roUege admission test scores declining 
during the 1970s, many educators searched for 
possible causes of this decline. One of the most 
interested parties in discovering why test scores 
were decreasing was the College Board. This sec- 
tion discusses the background and results of a 
major study supported by the College Board, On 
Further Examination; criticisms of this report; 
and theorlv*s advanced since the publication of 
On Further ExcwrCnation on possible causes for 
declining test scores. 

On Further Examination 

In October 1975, S. P. Marland, Jr., then 
president of the College Entrance Examination 
Board, appointed a 21-member "blue-ribbon" Ad- 
visory Panel on the SAT score decline. The Ad- 
visory Panel vas empowered to investigate the 
complex and interrelated issues pertinent to* the 
unexplained decline in SAT scores, examine the 
p8ychom«tric integrity of the tests, and iden- 
tify areas of additional research necessary for 
dealing effectively with the test score decline. 
Chaired by Willard W. Wirtz, former U.S. Secre- 
tary of Labor, the Advisory Panel was given free- 
dom to deliberate issues as it chose and to re- 
port its findings in the public interest. 
(297:111) After a two-year investigation at a 
cost of $600,000, the Advisory Panel's report. 
On Further Examination and new research, were 
released in 1977. (107:61 J Since the issues in 
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the report were of national interest, the Panel 
emphasized that any generalizations regarding 
the SAT statistics should be carefully quail- 
fled, and ''should not be extended to cover the 
situation of American youth as a whole or the 
overall effectiveness of the learning process." 
[297:5] 

The Advisory Panel concluded that there 
were actually two separate SAT score declines 
characterized by different causal factors. The 
first decline, between 1963 and 1970, was due 
primarily to changes in the SAT-taking popula- 
tion. Compared to the past, the SAT was measur- 
ing a broader cross section of American youth 
which included larger proportions of character- 
istically lower scoring groups of atudents from 
disadvantaged socio-economic backgrounds, ethnic 
minorities, and worten. The second decline in 
SAT scores, between 1970 and 1975, was due to 
pervasive changes affecting both higher- and 
lower-scoring groups. [297:13, 45-46] Specifics, 
of the first decline in SAT scores related to 
compositional changes in the SAT-taking popula- 
tion follow: 

• SAT score averages began to decline with 
the post-World War II wave of students. 
Between 1960 and 1970 the number of SAT- 
takers tripled, and the number of 18-year- 
olds increased by one million between 1964 
and 1965. [297:13] 

• Twenty-five years ago, about half of all 
students were remaining in school through 
the twelfth grade. By 1970 the percentage 
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had growi to three-fourLhs . Hie Increase* 
f*in young people remaining in school re- 
sulted in a "lowering of the averages on 
examinations taken previously by more 
select groups." [^^mphasis in the original] 
[297:13-14, 24] 

• Students from families with lower-than- 
average incomes, under $6,000 ir 1977, 
averaged about 100 points lower on both 
the verbal and mathematical sections of 
the SAT compared to students from high- 
income families ($18,000 and over). 
[297:15] 

• Few ethnic minority groups took the SAT 
in the early 1960s. Biack SAT-takers in 
1963 comprised between one and two per- 
cent of the SAT population. By 1972 this 
population had risen to 8.7 percent. 
Blacks averaged approximately lOQ points 
below the national average on the verbal 
test and about 115 points below on the 
mathematical section of the SAT. [297:15] 

• The percentage of women taking the SAT 
rose from 42.7 percent in 1960 to 51.1 
percent in 19 77. Women's lower scores 
on the mathematical section of the test, 
the panel observed, reflected the "tradi- 
tional sex stereotyping of career oppor- 
tunities ana expectations." [297:16, 19] 

• The number of SAT- takers applying to pres- 
tigious and selective four-year colleges 
and univer3ities remained constant until 
1967. Thereafter, an increasing pcraeyii- 
age of test takers began to apply to less 
selective colleges, colleges with open 
admission policies, two-year colleges, 

and schools with a technical or vocational 
Interest. 

• Between 1961 and 1974 the percentage of 
students who requested to have their 
scores sent to selective colleges dropped 
from 13.2 percent to 5.6 percent. Simi- 
larly, the number of requests to have 
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scores sent to "research" universities 
declined from 10.5 percent to 6.4 
percent. [^97:17-18] 
• There was also a decrease in the percent- 
age of students repeating the SAT. ^ /This 
,had a small effect on test score averages 
since SAT-repeaters typically averaged 
15 to 30 points higher the second time. 
[297:18] 

The Advisory Panel cautioned, howevpr, that 
identifying the increased numbers of blacks, 
women, and poorer youths who took the SAT as 
causes for the test score decline would risk 
"irresponsible headlines." [I'ifil^] The increased 
number of blacks would account for a decline of 
about five points or less over the entire 14-year 
period. "Despite statutory guarantees of equal 
opportunity," the Panel said, "the society has 
not yet developed either the educational means 
or the mores that will bring children with dif- 
ferent racial roots to a parity of aptitude, as 
the SAT and other tests measure it, by the time 
they reach the twelfth grade." [297:16] In- 
creased participation of women, they felt, would 
account for about a four or five point decline 
in the mathematical average, but no decline in 
verbal averages. Altogether, the changes in 
the SAT-taking population, especially "in terns 
of ttte test takers coming from higher-" and 
lowerAfcoring groups and in terms of their 
plans fVr going on to college," accounted for 
an estimated two-thirds to three-quarters of 
the SAT score decline. [297:17-18] 

The second decline in SAT scores, between 
1970 and 1975, was related to events in the 
schools and society at large. The Panel con- 
cluded that there was no one cause for the jj>AT 
decline but rather a "virtually seamless web of 
causal connections." [297:25, 48] Among the 
school and societal factors the Panel cited as 
contributing to the decline in SAT scores were 
the following: v 
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• Although ^ell-incentioned , many curriau^ 
turn changes had reduced the continuity 
of study in major fields with consequent 
effect on verbal development* "A sig- 
nificant dispersal of learning activi- 
ties*' had occurred in the schools, that 
is, a' reduction in the number of courses 
j^equired of ^11 students and the addition 
of elective courses, [297:46] Research 
cited by the Panel also indicated this 
trend. For example, Harnischf eger and 
Wiley, using nationwide data, reported 

an 11 percent drop in English enrollments 
in grades 7 through 12 and a 50 percent 
drop in advanced English between 1971 and 
1973. A survey of elective courses in 
Massachusetts conducted by the Massachu- 
setts Department of Education between 
1971 and 197^ ^^^^ more than a 50 percent 
increase in English/language arts courses 
in 43 high, scjiools, but no significant 
correlation was found between the number 
of electives added and the students' SAT 
scores. California reported a 19 percent 
drop in enrollments in basic English 
courses between 1971-72 and 1974-75, while 
enrollments "plummeted" 77 percent in Eng- 
lish composition classes, (297:25-261 The 
Advisory Panel, however, did not condemn 
elective courses since it felt that many 
of them contributed to t^uudent interest 
and motivation with no "negative effect - 
on basic learning," [297:46] The rela- 
tionship between SAT scores and the cur- 
riculum led the Panel to observe that 
"less thoughtful and critical reading is 
now being demanded and done," and that 
"careful writing has apparently about 
gone out of style, "*[297:27] 
• Student absenteeiem increased consider- 
ably with absence rates of 15 percent or 
■ore ccNonon in some schools. The Panel 

* observed that absenteeism hurt both the 
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absentee and the class, since the teacher 
often had to repeat a lesson to bring 
everyone up-to-date, [297:29] 

• Grade inflation indicated declining edu- 
cational standards. The Panel cited an 
American College Testing Program study 

t 

which reported a 25 percent increase tn 
the proportion of "A" and ".B" grades be- 
tween 1967-55 and 1974-75. Students in- 
creasingly accepted the idea that promo- 
tion from one grade level to -another was 
"an entitlement rather than something Lo 
be earned, or denied.'* [297:29] 

• An analysis of reading, history, and 
other textbooks showed more space devoted 
to pictures; wider margins; and shorter 
words, sentences and paragraphs. Since 
numerous exercises in textbooks had an 
"objective answer"^ format , requiring 
underlining, circling, and filling in 
blanks, many students found less reason 
to write, [297:31] 

• Tfie Panel stated that the extensive time 
students spent watching television, be- 
tween 10';000 and 15,000 hours by^age 16, • 

detracted from homework and time spent 

*■ 

developing skills measured by college 
entrance examinations. They felt that 
TV raised children's expectation levels, 
which by comparison, made what they en- 
countered In the classroom appear 'rather 
bland. The Panel noted that although 
television had become a "surrograte par- 
ent, substitute teacher" it still had 
the potential "of becoming lea;"ning's. 
most fertile grove," [297:35-37, 471 

• Changes in the role of the family, espe- 
cially the increasing number of children 
in single-parent families, may have had 
a negative impact on students' college 
entrance examinations, [297:47] 

• The Panel said the 17-year-old of 1977 
was not the same in mind or body as the 
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17-yL"ar-old of 1947. Clianguig life 
styleSf values, earlier physical roatura- 
lion, higher mobility, drugs, and contra- 
ceptives had coincided with increasing 
problems of discipline and abseateeism 
^ among high school students. Howev^er, 

these factors could not be translated 
into SAT test score declines. [297:35] 

• Whether or not the disruption of national 
life during the 1967-75 period (the Viet- 
naiL ^ar, political assassinations, burn- 
ing cities, corrupi national leadership) 
affected the motivation of test takers 
preparing for their college entrance ex- 
aminations remained unclear. The Panel 
concluded that the period covered by the 
second decline ^ SAT scores was a diffi- 

% cult one in which to grow up. [297:37, 43] 

• There was an apparent dimunition in stu- 
dents' learning motivation. The Panel 
noted Chat the "cur/e of the SAT scores 
has followed very closely the curve of 
the entire- nation* s spirits, and self- 
estoem and sense of purpose." [29^:48] 

In summary, the Panel cautioned that the SAT 
score decline was a complex subject filled with 
nuances, qualifications, and doubts. The SAT is 
a "limJ.ed instrument" and should not be viewed 
as "the sole thermometer for measuring the health 
of schoolr,, family, and student," [297:40] While 
high school grades still remained the best single 
predictor ol college performance, the psychometric 
Integrity of Lhe SAT was affirmed as a valid in- 
strument in determining how well students will 
perform during tneir H^'it year in <oilege. Fur- 
thermore, the Panel noted tfiat the predictive 
validity of the verbal and mathematical tests had 
actually increased between 1970 and 1974. [279:9] 
Problems related to declining test '"cores were 
noi. Isolated schooj. problems, but rather society's 
^iroblems. [297:461 "'Whi le it appeared that educa- 
tional standards had diminished, the advisory 
Panel wondered why the SAT score decilne .ictuallv 
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had not been larger. [297:45] The Panel's report 
concluded on an optimistic note; "We find noth- ' 
ing in the record we have reviewed to discourage 
the conviction that learning in America can be 
made all that is hoped for it." [297:48] 

Criticisms of On Further Examination 

The Advisory Panel's report. On Further Ex- 
amination , found no one cause and no single pat- 
tern of causes for the decline in SAT scores 
Much of the report blamed society as a whole for 
declines in educational standards: changes in 
the role of the family, television, lack of moti- 
vation, and a "decade of distraction." [297:37, 
48] Since there was little quantitative evidence 
available about the precise mfluer'^es of those 
factors on test scores, many of the Panel's find- 
ings were expressed in general terms as opinions 
and reflections. [193:15-16] Critics faulted the^ 
Panel for using "circumstantial evidence" to vali- 
date 1 variety of possible causes for declining 
admissions test scores. [245:290] Among the crit- 
icisms of the Advisory Panel's report were the 
following : 

1. It was merely a "policy paper" which 
attempted to influence the public 
schools in the directions suggested by 
the College Board and the Educational 

^ Testing Service. [144:7] 

2. Although the Panel emphasized that the 
SAT's validity as a predictor of suc- 
cess in first-year college performance 
had actually increased, the SAT still 
remained ''second best in a relatively 
poor string of predictors." [144:5] 

3. Teachers had known first-hand for some 
time many of the Panel's conclusions 
regarding changes and conditions in 
the schools. [239:6] 

4. In light of the drastic changes in 
society which the report documented, 
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serious questions were raised about the 
capability of a standarized multiple- 
choice test designed in 1941 to assess 
students in^^the 1960s an^ 1970s, as- 
serted John Ryor, former president of 
the National Education Association 
(NEA). [239:8] 
'5". Ideht if Ication of high school elec- 
tives as a ^ssible contributing fac- 
tor in the SAT score decline and the 
Panel's defense of flexibility and di- 
versification were paradoxical points 
of view. J252:86] While the Panel did 
not condemn electives, its conclusions 
effectively did just that. [144:6] 

6. School boards that attempt to evaluate 
their curriculums based on SAT scores 
were, in effect, making the SAT a "basis 
for a national standard.^ [•^39:8] 

7. Instead of attacking the misuse -of test 
score data, the Advisory Panel engaged 
in "unsubstantiated opinion" about the 

*state of literacy achievement, although 
SAT scores do not provide -'adequate data 
for such judgments. [144:5-6] 

8. Arthur N. Applebee of the National Coun- 
cil of Teacliers of English observed that 
English teachers appeared to have been 
singled out as respons-ibie for the score 
decline. Applebee said the critical 
reading and careful writing and thinking 
that the Panel recotmnended should be part 
of the entire curriculum, not Just Eng- 
lish classes. [20:2] 

9. In an editorial in The Sngliah Journal^ 
Stephen Judy criticized the Panel's 
"firmest" conclusion th^i* less thought- 
ful ami critical reading was being done 
and demanded, and that careful writing 
had gone out of style. Judy queried 
whether the Panel had actually collected 
and compared samples of writing to as- 
sess the changes and whether the Panel 



ERIC 



had measured how much "thoughtful and 
critical reading" is being done. [144: 
6-7] 

10. Dtibpite the Panel's warning to schools 
about becoming more rigid, restrictive, 
and uniform, the report encouraged his 
kind of activity and prompted the cry 
for "back-to-basics." [239:8] 

11. The Panel's perceived message to the 
public and politicians was chat schools 
"deserted the basics" and replaced them 
with innovations, electives, and enter- 
tainment. This interpretation, accord- 
ing to one educational observer, has 
resulted in minimum competency laws in 
many states. [245:292] 

12. The NEA asserted that the Advisory 
Panel's report raised significant ques- 
tions labout unchanging standards, test 
validity, cultural bias, and instruc- 
tional change — questions that warranted 
still further examination. [193:18-19] 



Recent Theories for Declining Test Scores 

Since the release of the Wirtz panel's re- 
port. Further Examination^ in August 1977, 
SAT test scores have continued to decline, but 
not as steeply as in the past. le continuing 
decline has prompted further speculation about 
the possible factors influencing test scores. 
Some educators maintain that there is no way of 
ki. ^wing whether or not there has been a decline 
in s jdents* academic achievement because of the 
margin of error in the tests. [60:13] Further- 
more, they point to "then and now" studies which 
indicate that students* reading achievement is 
about the same today as in the past and in fact 
compares favorably with students' reading achieve- 
ment In other countriej. [86:3] Other educators 
claim that the media has confused the SAT score 
decline with the overall effectiveness of 
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American education. Thsy believe that a series 
of misinterpretations has encouraged the public 
to believe that scnools are graduating increas- 
ing numbers of illiterates. In addition, some 
say that this confusion has resulted in a re- 
turn to teaching the basics and minimum compe- 
tency testing, without really knowing if this 
method of instruction is necessary. [87:528] 
Still other educators believe that these polit- 
ical responses to educational problems tend to 
focus more attention on testing than on the in- 
structioiial process and the improvement of ver- 
bal and mathematical abilities. [241:2] In any 
case, the public has demanded a quick cure for 
what it perceives to be a decline in public edu- 
cation. While the exact cause or causes of de- 
clining SAT scores remain speculative, according 
to some educational analysts, it is far "easier 
CO damage the educational system than it is to 
improve it." [272:2] Highlights of some recent 
theories and discussions regarding declining test 
scores follow. 

A March 1978 report of the National Academy 
of Education Committee on Tes^ing and Basic 
Skills identified four school factors that had 
contributed to declines in SAT scores and writ- 
ing skills: (1) a proliferation of n>nintellec- 
tually rigorous courses xC 9s demanding than the 
traditional regimen of English, math, science, 
and social studies, accompanied by a decline in 
the intellectual standards of formerly rigorous, 
but still required courses; (2) confusion about 
the appropriate roles of teachers and "of en con- 
tradictory modes of appropriate pedagogic behav- 
ior", (3) a decrease in the amount of time spent 
"on task," with some "good" classes devoting only 
60 or 70 percent of their inst 'uctional day to 
learning; and (4) less opportunity for intensive 
study by academically talented students at the 
secondary level, which contributed to the decline 
in the number of high-scoring students on the SAT. 
The National Academy of Educa: ton panel empha- 
sized that the effective use of school time spent 
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"on task" in whatever the curriculum callea for 
would be a "significant reform in Ameruan 
schools." [190:1-2] 

Vito Perrone, dean of the Center for Teach- 
ing and Learning at the University of North Da- 
kota, criticized the National Academy of Educa- 
tion*r report as laden with overgeneralizat ions 
and opinions, with little substantiated data to 
support the repot l's recommendations. Perrone 
said there was no empirical evidence that a pro- 
liferation of nonintellectually rigorous cou<|es^ 
confusion about the appropriate role of teachers, 
slackening of "on task" attention, and a disman- 
tling of opportunity for intensive study leads 
to declines in writing skills and SAT scores, 
Perrone reported that data from the International 
Evaluation of Educational Achievement showed that 
U.S. students compared favorably with their peers 
in other nations. [220:20-21] 

Christopher Jencks, professor of sociology 
at Harvard University, maintains that young 
people's test scores today are no better and no 
worse than their parents' test scores in the 
19A0s. Only if the trend is extrapolated into 
che distant future does it appear alarring, 
Jencks said. "The decline in test scores does 
not prove that students are stupider than stu- 
dents ten or fifteen years ago. They may have 
exactly the same level of aptitude but be di- 
recting it to other activities." Further, since 
schools do not teach aptitude, SAT scores are 
not useful in assessing whether high schools 
are doing their jobs. [141:13] Jencks believes 
that the only way to Judge the significance of 
the decline in test scores is to examine the 
test item by item to ascertain whether each ques- 
tion is actually Important. [23:1-2] Rather than 
trying to restore respect for authority figures 
such as teachers and parents via the back-to- 
ha'sics movement, he suggests that schools should 
be trying "to restore respect for the value of 
reason, in all its complexity." [141:14] 



In April 1979 tchtimony before the Senate 
Subcommittee on Education, Arts and Humanitieb, 
Roger Farr, president of the International Read- 
ing Association and Professor of Education at 
Indiana University, stated that fluctuations m 
reading tichievement data could be ' traced to 
such fac:ors as changing promotion policies 
schools, the move toward open enrollment poli- 
cies, an increased emphasis on encouraging mi- 
nority populations to seek more education, and 
a definite reduccion in school dropouts." He 
commented, however, that these fluctuations made 
it seem as though a change in reading aclut'vc- 
ment was occarring, but what was really happen- 
ing was a change in the composition of the test- 
tal^ng population. He testified thit the SAT 
was not a valid assessment of reaching achieve- 
ment in the public schools because it measures 
a very high levf>T of comprehension, not functional 
literacy. Since the SAT is admi.ni?tered to col- 
lege-bound high school juniors and seniors, Farr 
said an extension of the interpretat on of scores 
on the SAT to attack cading education in the 
United States was "a w,^jss misuse of such tests 
as well as a patently invallu arguinent." 
(86:2, 51 

In October 1979, Shirley Hill, president of 
the National Council of Teachers of Mathematics, 
testifie:^ before the Houst Subconmii t tee on Elemen- 
tary, Secondary and Vocational Education. Accord- 
ing to Kill, many schools are now teaching objec- 
tives that can be easily taught and rested. She 
testified that many teachers have "settled down 
to a single-minded dedication to one gonl--high 
scores ^.n tests of .ilnlmal skills." dill added 
that "stiort-term retention is the goal, not Icn^- 
term retention and the ability to apply." [84:21 

Patricia Lund Casserly, a research scientist 
at KTS, reported that traditional attitudes and 
behaviors of guidance counselors, teachers, <ind 
parents toward females result in yoiing women not 
bein^ adequately prepared In high. school to pur- 
sue roll(*ge courses In mathematics, chemistry, 
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and physics, and to enter related prt)! esbions. 
Cissoriy examined curriculum and guidance poli- 
cies at 13 high schoo .s nationwide and approxi- 
mately 200 girls p irL Ic ipated in the st udy . She 
emphasized that math teachers should encourage 
young women to persist in mathematics courses. 
"We don't let students drop English because they 
have trouble spelling, or because their grammar 
is imperfect or because they don't en^oy the 
selected literature." Casserly said. "Let's not 
do -it in mathematics either." [289:7j 

According to Gordon Cawelti of the Associa- 
tion for Supervision and Curriculum Development, 
recent declines in SAT scores raise questions 
about the effectiveness of competency-based 
education. "The competency movement has been 
the political response to the back-to-basics 
movement," Cawelti said, "and schools have been 
preoccupied with doing needs assessments and 
testing at the expense of focusing on direct 
instruction." Research evidence, he added, in- 
dicated that no significant increase in achieve- 
ment can be anticipated without an increase in 
direct instructional time. Cawelti called for 
curriculum validation studies to determine the 
extent to which the high school curriculum 
teaches the verbal and mathematical reasoning 
abilities measured by the SAT. [241:2] 

According to W. Timothy Weaver from the 
School of Education at Boston University, there 
is evidence of declining standaras and much 
lower SAT verbal and mathematical scores among 
entering freshmen in teacher education compared 
to entering freshmen in other fields. In 14 of 
the 19 postsecondary institutions Weaver sur- 
veyed, there wa^ a significant decline in the 
quality of applicants who intended to major in 
'education as college-bound seniors sliifted ca- 
reer choices to those in greater demand. [290: 
5681 At eight teachers' colleges tlie verbal 
test score of freshmen fell from 472 in 1970 to 
417 In 1973, whlcli exceeded the national declir e 
in SAT scores. | 290 : 5 70-37 1 | In 1975-76 the SA I 
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verbal score of Loilege-bound seniors who planned 
to major In education was 34 points below the na- 
tional* mean, 397 compared to 431, and the SAT 
mathematical score was 4 3 points below the national 
mean, 429 compared tc^2. Education majors were 
reported to be second from the last on the ACT 
^ tiiathematics test and tied for fourteenth place on 
the ACT English test in 1973-76, compared to stu- 
dents in 19 other career fields. [290:575] Weaver 
said the decline n SAT scores takes on added sig- 
nificance in education because "if members of this 
group constitute most of those who will apply to 
schools of education, then they also constitute 
most of those who will be accepted." [290:585] 

In 1979 the National Institute on Drug Abuse 
conducted a nationwide survey of drug use among 
^ approximately 17,000 high school seniors in 130 

public and private schools. The study, Dr*ugs and 
the Nation's High School Students: Five Year Na- 
tional Trends, found that the class of 19 79 had 
more experience with marijuana than any other 
previous cohort in American history. Other sali- 
ent findings were the following: (1) the percent- 
age of all seniors using marijuana at least once 
In their lifetime rose from 47 percent in 1975 to 
60 percent In 1979. [143:23] During the same pe- 
riod daily or nearly daily usage of marijuana in- 
creased from six percent in 1975 to 11 percent in 
1978; it remained unchanged at 11 percent in 1979; 
[170:1] (2) there has been a dramatic rise in the 
annual prevalence of cocaine usage with the p^,r- 
centage of users doubling from 5.6 percent in 1975 
to 12 percent in 1979; (3) the annual prevalence 
of inhalants increased from 3.0 percent to 5.4 per- 
cent, but this Is considered to be an underestimate 
since users often fail to report amyl and butyl 
nitrates under the Inhalant category; (4) the 
annual prevalence of stimulants rose from 15.8 
percent In 1976 to 18.3 percent In 1979. On the 
other hand, annual prevalence of sedatives, tr;m- 
.qulllzers, and heroin declined among senior*^. 
Sedatives dt-LllntMl from 18i2 percent In 1975 to 
14.6 percent In 1979; tranquilizers, from 10.8 
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percent m 19 77 to 9.6 percent m 1979; and 
neroin, from 1.0 percent in 1975 to 0.5 percent 
in 1979. [143:23, 28] According to Sidney Cohen, 
professor at the Lniversity of California at Los 
Angeles, a "juvenile stoned on pot or any drug 
during his waking hours" results in lost "learn- 
ing time, growing-up time, problem-solving time.'' 
[169:4] 

At a January 1980 meeting of the Senate Ju- 
diciary Subcommittee on Criminal Justice, Harold 
Voth, psychiatrist at the Menninger Foundation in 
Kansas, testified that marijuana smokers exhibited 
"loss of motivation, lowering of ambition" and 
desire "for excellence." H. Brian Berthiaume, 
program coordinator of the Phoenix School in 
Montgomery Coun*" M^ir^'land, testified that 
listlessness, poor attention spans, and lower 
grades of children who smoke marijuana have 
"serious raniif ications for the classroom." 
Berthiaume noted that students had trouble 
with complex tasks and become, "frustrated with 
difficult math problems." Senator Charles 
Mathias (R-Md.), who chaired the Senate Sub- 
coiTjnittee on Criminal Justice hearings stated 
that drug usage might contribute to cui^iculum 
oroblems. [78:3] 

The President's Commission on Foreign Lan- 
guage and International Studies reported a "se- 
rious deterioration in this country^ s language 
and research capacity," The Commission's re- 
port, released in November 1979, showed that 
only 15 percent of American high schoc?! students 
now study a foreit^n languaj^e compared to 24 per- 
cent 1.1 196S; only one in 20 students takes 
cuursoh in French, German, or Russian beyond the 
set ond year; and only eight percent of Americar. 
LulU'^es now require a foreign language for ad- 
mission, compared with 34 percent in 1966. 
(A'Fimis., ion chairman James A. Perkins called 
u{>on schools, colleges, and un i vers i t. les to re- 
instate foreign lariguagt^ i equircrrn-nt s , (^l9:'i-7] 

A professor of rad lol t>gi ( ^ ) plivsics at the 
University of Pfttsburgli Stbool ot Medicine has 
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claimed there is a connection between low SAT 
scores in the 1970s and nuclear bomb tests in 
Nevada in the 1950s. [265:184] Ernest Sternglass 
said that radioactive fallout from atomic bomb 
blasts hindered the normal development of thy- 
roid and pituitary glands of fetuses. [242:A10] 
He cited a study which showed a three- to four- 
fold increase in thyroid conditions among young 
people in Utah 10 to 20 years after the fallout 
of the mid-fifties. [265:185] Sternglass also 
observed that the largest drop in SAT scores 
during the two-year testing period, 1973-74 and 
1975-76, occurred in the western region of the 
United States, where fallout was heaviest and 
mixed with rain from Russian tests in Siberia 
and American tests in the Pacific Ocean and 
Nevada. Using regional data obtained from the 



College Board, Sternglass noted that SAT 
scores declined 19 points in the western 
region, compared with 12 points in New Eng- 
land, 14 points in the Middle Atlantic States, 
and 13 points in the South. Children in Utah 
experienced a decline of 26 points, in contrast 
to children in Ohio who experienced a two point 
decline. [265:184] Other areas of the nation 
which received significant amounts of fallout 
experienced significant dips in SAT scores, 
Sternglass «isserted. [242:A10] 

Although there is considerable controversy 
surrounding the Interrelated factors which may 
hav2 contributed to declining test scores, the 
College Entrance Examination Board has not pub- 
lished any additional studies on the reasons 
for declining test scores since its 1977 report. 
On Further Examination. [161:1] 
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THE TESTING CONTROVERSY: RALPH NADER VS. ETS 



Until recently, almost all criticisms of 
tests and testing initiated within the psycho- 
metric profession, according to William W. Turn- 
bull, former president of ETS. As the costs of 
education have risen and the school population 
has declined, many consumers of education have 
not seen the increases in the quality of educa- 
tion that they expected. Consequently, the pub- 
lic has demanded accountability and improved 
pupil performance, which has led to an increased 
questioning of the educational process in an ef- 
fort to understand why student achievement has 
not matched anticipation. [283:105] This ques- 
tioning, however, has turned into an *'open as- 
sault" on the college admissions process £ nd 
institutional autonomy, in the opinion of George 
H. Hanford, president of the College Board. 
[273:4] Consumer groups, public interest groups ^ 
and some teachers* organizations are, in effect, 
"testing the tests." [47:2; 123:1] Turnbull has 
indicated that the national debate about standard- 
ized testing has shifted substantially from one of 
inquiry to a declared "uar against testing." 
(emphasis in the original) He has characterized 
these most recent attacks as "among the most sus- 
tained and hostile assaults on an applied social 
science ever seen in this country." Because the 
Media and political arenas have become battle 
sites, Turnbull believes that many untruths and 

ETS president William W. Turnbull resigned 
in October 1980 and plans to study the testing 
process as a resident scholar at the ETS facility 
in Princeton. He has also called for jCTde debate 
on testing for college admissions. 
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misleading statements have gained popular ac- 
ceptance without a complete 'examination of the 
facts and their possible consequences for all 
concerned. [68:2] 

According to Turnbull, the attacks upon 
standardized testing appear to focus on the pos- 
sible misuse of test results and the role of ETS 
as one of the nation's most prestigious testing 
organizations. [68:2] But there are a host of 
subissues. Foremost among these concerns are 
whether the SAT measures aptitude and predicts 
first year college perf6rmance; whether the 
tests are culturally biased and exclude a dis- 
proportionate number of minority applicants 
from college; whether the test scores relate 
directly to tamily income and perpetuate a 
"class system in the guise of merit;" and 
whether the t,esting organizations are account- 
able for products which affect the lives, 
careers, and aspirations of millions of 
Americans each year. 

The continuing controversy over standard- 
ized testing peaked in early 1980 with the re- 
lease of a Ralph Nader sponsored report on ETS 
titled The 'Heig>^ of ETS: The Corporation That 
Makes IJp Minds. [188] One educational observer 
speculated that the Nader study could eventually 
affect not only the future of the College Board's 
SAT tests, but the future of all standardized 
testing, including tests given at the elementary 
school level. [173:A19] 
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Origins of the Nader-ETS Feud 

The feud between Ralph Nader and ETS extends 
back to 1974 when a Nader associate, Allan Nairn, 
then a high school graduate, began a.n investiga- 
tive study cr the claims ETS made about its 
standardized tests. 1104:5] Nader formulated the 
concept for the report as he toured colleges and 
universities across the countr> . Students ap- 
proached him to complain that, in spite of their 
grades and extracurricular activities, they had 
been wrongly Judged on the basis of a three-hour 
examination. Nader reported that many students 
felt that their educational and career opportuni- 
ties had been irreparably damaged or destroyed by 
their low test scores. Because these students 
did not "test out," they believed they lacked the 
aptitude to go to graduate and law school, they 
exhibited an attitude of resignation, and they 
viewed the results of these multiple-choice tests 
as "revealed truth about themselves." (188: ixj 

In response to the students* complaints, 
Allan Nairn and others, under Nader's sponsorship, 
formally approached ETS officers for interviews 
and published materials. [I88:xi] Nader claimed 
that ETS executives demanded financial coajpensa- 
tion for time given in interviews, retention of a 
court reporter to take transcripts, a pledge that 
the information obtained would not be used in lit- 
igation, an4l the power of reviewing the study 
prior to its publication. [188:xii] Nader said 
that previous investigative studies he had con- 
ducted of General Motors, DuPont, and Citibank, 
were "child's play" compared to ETS and its 
"seige-mentality." (171:23; l88:xiv] 

In rebuttal to Nader's statement, ETS*s Turn- 
bull said that when it became apparent that Nairn 
wanted to conduct an intensive, time-consuming 
study, ETS agreed to participate, provided that a 
systematic set of procedures would be followed. 
Accordingly, on two separate occasions, Allen 



Nairn and Thomas Sutton contacted ETS and were 
given well over 100 publications and access to 
the ETS library. Six weeks after their second 
investigation began, however, the researchers 
unexpectedly disappeared without completing all 
of the interviews planned. Turnbull reported 
that there was no explanation from either Nader 
or Nairn for this action. [284:1-2] 

In January 1980, after five years of work, 
Nairn, now a 24-year-old Columbia University 
economics student, and his associates released 
their 554-page study. The Reign of ExS: The Cor- 
poration That Makes Up Minds. In the foreword 
to the report, Nader criticizes ETS for its 
extraordinary power of deciding who advances 
through what school, a power that wouxd have 
created a furor years ago "If a governmental 
agency had possessed such authority. [188:xvi] 
According to Nader, the report shows that ETS's 
claims for its aptitude tests are insupportable. 
(188:xvii] Further, Nader says that a "one-time 
three hour gamble which can determine a life's 
pathway is simply not compatible with what is 
known about human personalities, their capacity 
for growth, their diversity and versatility." 
[188:xv] 

Calling the Nader and Nairn report on ETS 
and standardized testing an "anti-climax after 
a five-y( *r b.^|kd up," Turnbull stated that much 
of th"; material was dated and its conclusions 
were erroneous. He emphasized that ETS had 
tried to correct the record repeatedly but that 
the corrections had been ignored and inaccurate 
statements repeated. Turnbull accused Nader and 
Nairn of confusing monopoly with success, blam- 
ing the tests for showing that minority students 
are inadequately prepared compared to majority 
students, and ignoring the fact that standardized 
tests reduce the possibility of unfairness in the 
aduH^ssions process. By attempting to shake the 
public's confidence in ETS and standardized test- 
ing, Turnbull claimed that Nader was trying to 
eliminate standardized testing altogether and 
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substitute college admissions standards with his 
o%m, as yet, undetermined subjective values. 
Also, TurMbull accused Nader of being out of 
touch with educational needs and public senti- 
ment concerning testing. (285:1-3] 

According to Turnbull, the major criticisms 
of ETS presented In Nairn's report appeared In 
the May 1975 Issue of Ladies' Home Journal, which 
Indicated that a verdict had been reached long 
before ETS' "trial'* started. 1 285:1] The report, 
said Turnbull, vlllfuxly Ignored many of the new 
Initiatives ETS had recently undertaken. He sug- 
gested that a reasonable perspective toward 
standardized testing should be taken to Improve 
both the tests and their use. [68:2] "If testing 
Is weakened,'* Turnbull cautioned, "education a^^ 
society will be the losers." [285:3] 

Major IS8U69 in the Debate 

Highlights of 17 major Issues debated between 
Ralph Nader and ETS, and between testing critics 
and testing advocates follow. 

The nation's gatekeeper. — Allan Nairn has 

^charged that ETS Is "the gatekeeper to educational 
Slid career opportunities" Ir. the United States. 
[188:292] In Its role as the nation's gatekeeper, 
ETS, In effect, determines who can attend college, 
graduate school, and professional schools, as well 
as who can be certified as a teacher, auto mechanic 
plund>er, and beautician. [184:2; 171:22] By claim- 
ing It has evolved the "science of mental measure- 
ment," ETS protects and enhances Its role as the 
gatekeeper; however. Its tests actually measure 
little more than how a candidate responded to a 
few multlple-cliolce questions, Nader asserted. 
(184:2] Similarly, Benjamin L. Hooks, president 
of the National Association for the Advancement 
* of Colored People, charged that ETS's testing 

Instruments which certify, classify, and stratify, 
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'*have effectively and disproportionately screened 
out blacks and other minority" candidates, thereby 
limiting their access to employment, colleges, and 
professional schools. [131:1] 

ETS, on the other hand, challenged Nairn's 
allegation that it is the "arbiter of adraisslonr" 
or "gatekeeper" to higher education in America. 
ETS articulated that colleges, graduate schools, 
and professional schools make their own decisions 
regarding which candidates to admit based on each 
institution's own criteria. These criteria are 
determined by administrators and faculty at these 
institutions and by state boards of education. 
[77:11] Because the selection process varies 
considerably from institution to institution, 
there is no single "gate" in the admissions proc- 
ess. According to ETS, its standardized tests 
serve as a means of testing in, rather than as a 
means of testing out, of opening gates to oppor- 
tunity, not of closing them. During the past two 
decades, ETS reported that the expanded use of 
tests has accompanied an increase in the propor- 
tion of minority and women candidates in insti- 
tutions of higher education. [65:7] George H. 
Hanford, president of the College Board, stressed 
that between 1970 and 1977 enrollment rates for 
blacks and Hispanic candidates increased by five 
percent and six percent, respectively. [121:5] 
Turnbull added that it would be hard to infer 
that admissions tests have barred college doors 
to minorities and the disadvantaged. [68:4] 

Monopoly power. — According to Nairn's report, 
ETS has a complete monopoly in eight uf its top 
ten testing markets. [188:260] Nader character- 
ized this situation as unprecedented in corpo- 
rate history. [184:1] Terry Herndon, Exective 
Director of the N£A, reported that EtS controls 
a key 14 percent of the total standardized test- 
ing market, and that its yearly gross Income is 
nearly four times as large as its nearest 
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competitor. [126:2j Roger Lennon, senior vi^e- 
/ president of Harcourt, Brace, Jovanovich, Inc., 
stated that ETS enjoys a privileged adv-'ntage 
over its rivals in private industry since "aca- 
demic types tend to feel more at home dealing 
with something that isn't perceived as a commer- 
cial enterprise/' [300:18] Over the past 30 
years, it has been estimated that ETS*s standard- 
ized tests have impacted upon the lives of 90 
million people. [12o:zj 

ETS asserted that Nader and Nairn confused 
monopoly with success, and further, that schools 
and colleges are free to choose among a variety 
of nonprofit agencies, government agencies, and 
private companies to carry out their testing pro- 
grams. While ETS is a major element in the test- 
ing field, the company states that it is proud 
that so many Institutions use its services because 
the standardized testing market is so highly com- 
petitive. Other commercial enterprises like/CTB/ 
McGraw-Hill, Psychological Corporation (a divi- 
sion of Harcourt, Brace, Jovanovich, Inc.), Science 
Research Associates (a division of IBM) , Houghton 
Mifflin, and the Measurement Research Center (a 
division of Westinghouse Corporation), have finan- 
cial resources similar to those of ETS^ [65:3; / 
70: 2J ^. \ 



Forced consumption. — Nairn stated that test 
takers are "captives*' who have little, if any, 
choice: as involuntary consumers they have no 
Say in determining whether they will pay and take 
admissions tests. [188:262] Currently, the SAT 
is required by 50 percent of the nation's colleges, 
the <;raduate Record Examination (GRE) by 75 percent 
of the graduate schools, the Graduate Management 
Admissions Test (GMAT) by 80 percent of business 
schools, and the Law School ^Admission Test (LSAT) 
by 100 percent of law schools. [238:4A; 187:580) 
In short, most students must take tests developed 
by ETS, or face abandonment of their educational 
plans. Some see this as a double jeopardy 
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situation for, as one parent commented, the can- 
didate is obliged "to generate evidence which may, 
and very often is, eventually used against him." 
[188:261-262] 

In contrast, Educational Testing Service 
emphasized that candidates who register with RTS 
to take an admissions test seem to associate the 
testing organization with the test requirement *r 
But the requirement actually comes from the in- 
stitution to which the candidates are applying, 
or from licensing and certification agencies that 
establish their own crittwria. Moreover, many 
colleges and agencies exempt candidates from tests 
or use other methods of evaluation. ETS said its 
so-called power over candidates is a myth because 
it merely provides the tests, and has no influence 
on whether or not the candidates will be tested. 
[65:7] 



Accountability. — Although ETS maintains that it 
is accountable to its client groups, these groups 
are not free to choose among different competitors 
for services, Naltn stated. With the exception of 
the College Board, ETS*s other client groups were 
created by ETS to sponsor programs it already 
owned. Specifically, Nairn said thi LSAT and 
GMAT client boards were created by ETS in 1953-54. 
Other client boarde have been created since then, 
such as the Graduate Record Examinations Board 
in 1966, [188:303] "Although the client groups 
enjoy varying degrees of autonomy," Nairn wrote, 
"whatever authority they hold is granted under 
terms set by ETS as the owner of the test ques- 
tions." [188:304] Nairn also reported that as 
of 19 74, the New York State Board of Regents, 
which granted ETS its charter in 1947, had not 
communicated with, made any insoection of, nor 
required any submissions from ETS in its 27-year 
history, [188:282] 

ETS reiterated tliat its clients are Inde- 
pendent and that ETS is fully account. ibie to them. 
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Each client organization contracts with ETS for 
admissions testing and related services. Also, 
the decision to use ETS's services resides with 
the educational institutions and their represent- 
Vatives. ETS noted, for example, that from 1947 
to 1960 it developed and administered the Medical 
College Admissions Test for the American Associ- 
ation of Medical Colleges (AAMC) , but since 1961 
AAMC has contracted this work to other testing 
organizations. As a nonprofit educational orga- 
nization chartered under New York's education 
laws, ETS said that it is accountable to the New 
York State Board of Regents. [65:3] Furthermore, 
like all nonprofit organizations, ETS is account- 
able to the Internal Revenue Service. On a pro- 
fessional level, ETS is accountable to its Board 
of Tiustees and its staff. [70:1] 

Nonprofit status. — Nairn reported that ETS ob- 
tained its nonprofit charter from the New York 
State Board of Regents, and that the company was 
granted an exemption from federal income taxes 
under section 501 (c)(3) of the Internal Revenue 
Code. [188:299-300] Nairn suggesced, however, 
that ETS bears little economic similarity ^to l e 
majority of nonprofit civic groups, churches, 
hospitals, and schools because ETS is an enter- 
prise "selling consumer products on a national 
scale." Since ETS has no shareholders, it is 
immune from tne risks associated with public 
ownership, such as responding to stockholder 
suggestions or complaints. "Its freedom from 
antitrust jurisdiction facilitates the estab- 
lishment of client relationships," Nairn com- 
mented, 'which help insulate ETS from the mar- 
ketplace of consumer choice." [188:298-299] 
Yet, In spite of ETS's nonprofit status, Nader 
said ETS declares approximate!, million in 
"nonprofits" each year. These fundo are used 
for corporate expansion and to maintain the ^^TS 
campua: a 400-acre headquarters, a $250,000 
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home for the president, and a $3 million hotel/ 
conference center; all constructed with candidate 
test fees. [184:1] Although ETS has only a small 
revenue of stocks and cash, Nairn stressed that 
ETS has an overwhelming political and economic 
interest in preserving its testing system. 
[188:395] 

In response, ETS stated that its nonprofit, 
tax-exempt status is similar to thousands of re- 
ligious, consumer, and charitable organizations 
which state and federal governments have deemed 
to be in the public interest. [70:2] According 
to ETS, the bulk of its income in 1978-79, some 
$85 million, came from services it provided for 
>est sponsors such as the College Board, graduate 
and professional school testing programs, and 
other testing activities. Almost $8 million 
came from outside sources such as local, state, 
and federal agencies, as well as from studies 
and activities funded by foundations. An addi- 
tional $1.5 million came from fees at the ETS 
conference center and returns on invested re- 
serves. [65:4] It was noted that ETS publishes 
an annual report, containing a complete finan- 
cial statement, which is sent to the educational 
community, the media, members of state legisla- 
tures, and the general public. [70:1] 

In 1978-79, ETS reported that its excess 
income over c:Xpenses amounted to $1.1 million 
or 1.2 percent of expenses. This money was usea 
for acquisitions, modifications of operational 
space, capital equipment, and working capital. 
ETS said that the company pays taxes on "unrelated 
income" as determined by IRS and voluntarily pays 
property taxes on its lan^s and buildings In 
Lawrence Township, New>Jersey. Although ETS 
stated that it maintains only a small invested 
reserve, less than one month of its annual pay- 
roll, the organization says that its Nonprofit 
status should not be construed to mean it pur- 
sues a strategy of no growth. [65:3; 70:2] 
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Cmt«r for Occupational and Professional Assess- 
ment.— According to Nairn, as the number of col- 
lege applicants began to plateau in the 1960s, 
ETS directed substantial amounts of its promo- 
tional effort to the occupational testing field, 
following students out of the classroom and into 
the professions. [188:325; 300:1] Since 1969, 
occupational testing revenues have grown five- 
fold, from $2.1 million to $11.2 million. [188: 
325] A partial list of the occupations for 
which the Center for Occupational and Profes- 
sional Assessment (COPA) had developed and ad- 
ministered written performance measures and/or 
program work includes accountants, bankers, real 
estate brokers, automobile mechanics, beauti- 
cians, plumbers, urban planners, electrical con- 
tractors, police officers. Peace Corps volun- 
teers. Foreign Service officers. Central Intel- 
ligence Agency workers, and National Security 
Agency members. [300:1; 283:104; 65:2] 

Turnbull stated that the formation of COPA 
was in response to consumer demands for compe- 
tence and certification of various professions. 
Working closely with representatives ot the 
sponsoring organizations and content specialists, 
COPA has developed assessmpnt measures for many 
occupations and professioni, particularly in 
health care. COPA has certification tests for 
gynecologists, obstetricians, opticians, respira- 
tory therapists, nurses, opthalmologists , and 
pharmacists. Turnbull also reported a trend 
toward self-assessment programs which provide 
professionals with the opportunity to assess them- 

elves in relation to their peers. Professional 
groups such as the American College of Dentists, 
the American Psychiatric Association, and the 
American Academy of Pediatrics have participated 
in such programs. [283:104-105] Now completing 
its sixth yfar, COPA^s new projects include li- 
censing and certification t^xaminat Ions for con- 
structjlon code Inspectors in the electrical, 
buildings plumbing, mechanical, and fire protec- 
tion fields; a continuing education program for 
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physicians; and new certification procedures for 
social workers, which combine test scores, ref-' 
erences, and experience into a composite score. 
[68:11] 



ETS data banks. — ETS has the largest data 
bank of personal, educational, and psychological 
information in the world, Nairn declared. Its 
files contain information on more than 32 million 
persons from 100 nations. [188:28] Testing 
critic Steven Levy reported that ETS has infor- 
mation on more than 15 million Americans, not 
only their test scores, but also the most detailed . 
forms about oersonal finance that many people will 
have to complete in their lifetimes. Levy stated 
that it is on "trust" that ETS protect^ this in- 
formation for the public. [166] 

ETS acknowledged that it maintains computer 
records of the test scores and other data about 
millions of candidates, but it stressed that this 
information is provided voluntarily by the candi- 
dates. Moreover, this intormation is completely 
confidential. It cannot be released to an insti- 
tution or agency without the specific permission 
from a candidate. The data, however, are avail- 
able to qualified researchers under rigorous pro- 
fessional guidelines which assure confidentiality. 
ETS noted that its intensive concern for confi- 
dentiality has lead, ironically, to allegations 
that EIS operates under a "veil of secrecy." 
ETS stated that it recognizes the rights of 
candidates and institutions to privacy with re- 
gard to information supplied by and about them, 
as well as ETS*s responsibility to guard infor- 
mation in its files from any unautliorized 
disclosure . [65 :2. A 1 



Test development. — in 1978 it was rt^ported 
thai the SAT wa.s written and updated by a staff 
of 58 test 5^j/)» lopers , which included KIS's own 
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Staff and a sizeable free-lance pool. [300:18; 
85:41] But the question writing process, accord- 
ing to Nairn, involves no fortniilas or statistics. 
[188:144] He reported that it takes anywhere 
from a half-hour to an hour to write a typical 
SAT verbal question, which is reviewed at several 
stages by two to five ETS staff members or con- 
sultants. [188:147] Questions which survive the 
review process are then pretested to establish 
whether they are "easy" (more than 70 ^percent get 
it right) or "hard" (Vewer than 30 percent get it 
right). If more than 90 percent get a c^uestion 
right cy^ wrong, it is eliminated. [300:18] Al- 
though ETS executives maintain that 150 steps 
are involved in the test development process, 
Nairn said that the najority of these steps are 
office procedures: < "i tep No. 65. Prepare Offi- 
cial Key for Reproduction, 66. Proof Key and Re- 
lease for Printing, 67. Key Sent to Printing, 
68. Print Key, 69. Distribute Key to Appropriate 
Divisions. . [188:147] Nairn said that over 

the past 30 years, ETS has accumulated an inven- 
tory of approximately 300,000 reusable multiple- 
choice test items, some of which have appeared in 
as many as 12 different tests. [ IgS : 145-146 ] 

ETS's Turnbull stated, on the other hand, 
that test development is conducted by ETS staff 
specialists who work in conjunction with repre- 
sentatives from the organizations and associa- 
tions for whom a test is being developed. ETS • 
staff specialists are aided by a committee of 
content area experts. All examinations, in turn, 
are reviewed, pretested, and analyzed by ETS 
staff specialists, an organization's program pol- 
icy board, and field experts. Additionally, ETS 
asks for advice from groups representing various 
disciplines and professions and requires minor- 
ity representation in the review process to elim- 
inate any possible culturai or racial bias. [283: 
p 

106) ^Before a single question appears on a test, 
it will undergo nearly 30 inspections, ETS 
asserted. [85:41] Becau-^e of the screening 
process and pretesting, it can cost $100,000 or 
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more to produce a new Graduate Record Examina- 
tion or a new Law School Admissions Test, and 
it can take ;i long as 24 months to prepare a 
single question included on a final test. [S5\ 
41; 188:147-148] 



\ ' 

Standard error of measurement. — The* standard 

error of measurement on a SAT score extends from 
30 points, beW)w a candidate's actu^ test score 
to 30 points above, Nairn exfilained. This means 
that if a candidate takes the SAT an infinite 
number of times, the "true score" o#- the average 
of all the scores would fall within this 60 
point .range two-thirds of the time, while a 
third of the time it 'would fall outside of this 
range. [188:157] Steven Levy said that, in 
theory, this "^eans a student with a score of 540 
should be considered identical to a student scor- 
ing 600. [166] In 1971 researchers Wing and 
Wallach analyzed data from 224 colleges of vary- 
ing degrees of selectivity. They found that at 
many of the schools a score difference of less 
than 60 points could alter chances for admission 
by 100 percent. Moreover, a score increase for' 
an applicant from 425 to 475 could raise the 
chances for admission by 70 percent. A decrease 
of 50 points, however, would lower the chances 
of admission by an equal amount. From this re- 
search, Nairn suggested that the test points 
which can alter a candidate's educational future 
are "derived from statistical formulas that trans 
form the answers to a few multiple-choice ques- 
tions into an elaborate three-digit report of 
*aptiuude.*" (188:156-158) 

Turnbull noted that while test scores as 
well <xs other source of information about human 
measurement and performance contain error, the 
error of measurement on standardized tests is 
well known and announced by publishers. Accord- 
ing to ETS, this consistency provider a c.ontrast 
to essfly examinations, which many studicvS have 
.shown to be unreliable, since grades f^ssigned by 
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readers vary considerably. Furthermore, unlike 
other forms of measurement such as teachers' 
grades, letters of recommendation, and personal 

Interviews, test scores are designed to provide ' 

c 

a conmon basis for the evaluation of a candidate's 
abilities to perform well in future academic work. 
[77:8; 69:4] 



Aptitude.**- The earliest founders of mental meai^- 
urement, including C^rl C'. Brigham, father of the 
modern SAT, «mphasized the relationship between 
test scores and social class, Nairn reported. 
These early psychome tricians believed that groups 
which s/ored low on tests were intellectually in- 
ferior. » [186 :652] Writing in The Atlantic, James 
l^^allows reported that early mental testers admin- 
istered IQ tests to newly arrived immigrants at 
Ellis Island in New York City, which resulted in 
the exclusion of certain racial and ethnic groups. 
For example, in 1912 Henry Goddard "scientifically 
proved" that 90 percent of Hungarians^ 87 percent 
of Russians, 83 percent of Jews, and 79 percent of 
Italians were * '^feebleminded. " [85:39] Today, 
Nairn claims that ETS views "aptitude" in the same 
way that the early mental testers viewed "intelli-^ 
gence." Nairn accused the psychometric profession 
of assuming a role beyond objectively reporting 
how people perform on multiple-cboice tests and of 
presenting the tests as scientific findings which 
purport to measure the basic quality of an indi- 
vidual's mind. [188:383] Similarly, two Harvard 
Medical School researchers, Warner V. Slack and 
Douglas Porter, stated that "aptitude, like in- 
telligence', implies native mental potential." 
Therefore, tne application of the word "aptitu'e" 
to any measurement based on test scores should be 
viewed with caution, [258:169] 

Slack and Porter emphasized «^that ETS pro- 
motes the SAT as a measure of ^ptitude and that " 
the public assumes high test ^qjFes indicate stu- 
dents have good minds and, therefore, benefit 
(torn favorabte judgments in comparison to those 
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who have low test scores. Nonetheless, Slack 
and Porter stated that the SAT has not been sub- 
jected to serious scrutiny because college ad- 
Mssions committees lack the resources and time. 
In fact, admissions committees are relying upon 
test scores to help expedite the time-consuming 
Job of selecting and rejecting applicants. Ac- 
cording to Slack and Porter, "if aptitude is de- 
fined simply as the capacity to do college work, 
the SAT has less relevance than either high 
school grades or other achblevement tests." [258: 
172] They contend that there is no evidence 
that the SAT measures anything except learnedj^ 
skills, for which training is effective. The/ 
pointed out that ETS's achievement test i in 
mathematics, science, and language actually have 
higher correlations with college performance than 
the SAT. Moreover, the English composition test 
is the only subject for which the SAT predicts 
as well. Slack and Porter referred to the SAT 
as another achievement test: "If stripped of 
the aura of 'aptitude' and considered together 
with other achievement tests and high school 
grades, the SAT is a third-rate 
college performance." [258:171] They called 
upon colleges and universities to follow the 
example of Bowdoin College and eliminate the 
SAT requirement. They also reminded students 
who are disappointed with their test scores 
that the scores do not reflect ."the quality of ^ 
their minds," [258:172] Ralph Nader added that 
it is presumptuous to define what aptitude is, 
let alone to allocate educational opportunities 
based on it. Such notions should be directly 
challenged, he said, [188:xvi] 

One of the most unfair sections of Nairn's 
report, according to George Hanford, president 
of the College Board, tries to link current test- 
ing procedures with earlier mental testing ex- 
perts whose views on racial superiority and eu- 
genic sterilization have long been discredited. 
[121:2] Hanford also accused Slack and Porter of 
ignoring the College Board's description of the 
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SAT, that Is, the SAT is "a test of aeveloped 
abilities — a measure cf wide-ranging learning 
experience — and that it Is not a con.ent-spe- 
clflc achleveuent test in the conventional 
sense of that term," [122:1] 

With regard to IQ tests, Turnbull stated 
th". 'TS neither defines intelligence, develops 
intelligence tests, ncr reports IQ scores. [284: 
2] ETS*s aptitude te3ts>, moreover, were never 
intended to assess innate Intelligence or unchang- 
ing abilities. Rather, they measure learned or 
ciquired skills which develop slowly over time 
through school and nonschool experiences. These 
tests are described as aptitude tests sincL they 
are not tied to a specific course of study, 
school curriculum, or program, [77: 7 J ETS as- 
serted that It is constantly seeking ways to im- 
prove the evaluation of abilities rf*lated to 
success in academic pursuits, develop tests of 
these abilities, and validate them using the 
most rigorous psychometric techniques currently 
available. [65:6] Whiit these measured skills 
are applicable to success In a variety of future 
academic endeavors, Turnbull commenr_ed: "To think 
that, at 18 years of age, people whose experiences 
have been vastly different can show their inborn 
potential through a test of verbal and mathemati- 
cal reasoning is naive, regardless of their cul- 
tural advautages or disadvantages.'* [69:4] 



StiHworth. — An individual's test score?, Nairn 
stated, often brcome the basis for important 
changes in sel f -percep t ion and self-concept. [186:. 
653] He cited several studies which document the 
effects of fest r^ores on candidates^ aspirations. 
In a slx-ytdr ;tudy of 80,083 students sponsored 
b> the College Board, Dale nilery of the Univer- 
sity of California wrote that "while in high 
school, students learn to judge themselves by 
these same measures [scores and high school 
grades] and, when they do not measure up, they 
either abandon certain educational and career 
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goals or try circ. tuus routes to achieve them," 
[188:216] Another study, conducted by Dennis 
Dugan, focused on the aspirations of students 
attending 47 high schools in the Boston area in 
1969, Dugan's study found that the student's 
SAT score ''has its greatest impact" on his or 
her decision to "enter the labor market, . in- 
stead of pursuing more education." [188:216-217] 
Nairn pointed out that there have been no stud- 
ies to estimate hov many lawyf^rs, doctors, and 
other professionals Irom the black, Latin, and 
other ethnic communities have been lost by rely- 
ing on ETS aptitude tests, [187:62GE] 

Similarly, Slack and Porter accused ETS of 
willful omissioiis in its technical publications 
whicn enhance the appearance of their proouct 
at the expense of the candidate's self-esteem, 
[258:172] Slack and Porter wrote that "if a 
student with a low SAT score believes that this 
score accurately reflec'.,. his aptitude, and that 
no study or prepiration could have altered his 
performance, his mental capacity is disparaged, 
and his self-esteem is weakened." [258:155] 
The ultimate tragedy, according to Nader, occurs 
when students accept their test results as a 
measure of their self-worth, Nar^er went on to 
say that broader And more diverse approaches 
for assessing individual performance are essen- 
tial in order to break this "vicious circle" and 
end r e "reign of ETS.'* [188:xivl 

in rebuttal, F.TS called Nairn's ^eport a 
distortion of the record. Guidelineri published 
in College Board bulletins and manuals for stu- 
dents, high school counselors, £'nd admissions 
officers include statements such as the following: 

• "Tests can be a useful mcJisurc of knowl- 
edge or academic ability, but no test 
predicts with any certainty 'success in 
life' or is in any way a measure of an 
individual's total worth," 

• "Test scores, like all types of measure- 
ments, pliysical as well as psychological. 




are not pertcctly precise and should not 
be treated as tuough they were." 
• "Although admissions tebt scores are good 
predictors of performanLu m college, 
thev .irti lu-t infallible predictors." 
[77:10-11] 

ETS further reporteii hat there is no real evi- 
ence to support the contention that taking a 
standardized test has a damaging psychological 
effect on a person. [65:7] Robert J. Kingston, 
former president of the College Board, stated 
that standardized "tests §re only one piece* of 
evidence used In one professional context." 
Kingston added that standardized tests reveal 
nothing about chai^acter, promise be ond college, 
chance of succeeding in life or "our ability to 
take our place as worthwhile human beings." 
[47:6? 



Craatlvity. — Nader and Nairn said that although 
standardized tests such as the SAT can determine 
a life's pathway, these tests cannot measure the 
variet^' of <?k lis which are essential to success 
in any kind of endeavor. [188:xv; 391] Nader 
claimed that ETS's tests do not measure important 
human qualities which have advanced civilization, 
such as creativity, wisdom, judgment, determina- 
tioii, st t.nlnai idealism, and experle*nce. [104:5] 
StTvndardized tests simply measure the specialized 
skill of multiple-choice test-taking, he asserted 
[184:2] 

ETS's [.'osldent acknowledged •'hat Nader was 
correct In statin? that the psychometric profes- 
sion has nr» large scale tests foi: assessing human 
q utilities such as creativity, idealism, stamina, 
3n<l larlng for mankind. rurnhull stated that 
tr.G-ie qailitlea are very important in society 
and that they should not be Ignored in favor of 
dfpenden'e on test.* aluie. He pointed out that 
ETS ha' he^r actively seeking to extent^ the raim 
av.'iMnble measures useful In assessing <i c.in^ 
dlda'.o's abiUtles. j 284:1] HanforJ observed 
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that the SA does not measure height, weight, 
skin ^.olor, geographic location, or economic 
status because"' the test is not designd to do 
these things, rianford affirmed that the SAT re- 
mains the best "national yardstj.ck of student 
abii ity. . .regardless of school, class, curricu- 
lum, famil> background, or other variables." 
[123:4] 



Meritocracy. — a British sociologist, Michael 
Young, coined the term "meritocracy" nearly 20 
years ago to describe a system of rewards based 
on ability and merit "rather than accident of 
birth." James Fallows observed that Young's 
term was satirical in intent, but Americans, in 
their search for an equitable system of classi- 
fication, appropriated it without its original 
irony. [85:43] Nairn said that many educators 
view the SAT as a standard of merit and, while 
recognizing that the SAT is less than perfect, 
they consider it an imperfect standard which is 
better than no standard at all. [188:392] Nairn 
said that this kind of argument fails to consider 
the availability of other measures. He said 
that ETS's own research has indicated that judg- 
ing candidates by their previous acoomy lishrit^nts 
would almost eliminate class and ethnic discrim- 
ination factors which are prevalent in the rank- 
ing of candidates by LTS scores. [188:392] 
(emphasis in the original) Nairn stated that 
the test system itself 'routinely damages the 
poor, the working class and the middle class 
rej.ative to the more affluent and privileged." 
[188:391] It also allows an administratively 
convenient way of avoiding the n s{m tn^ i h i 1 1 1 v 
of judging candidates. [188:393] According to 
Fallows, standardized tests have mereiy ^>xchanged 
one kind of privilege for anotncr. [H'^.A?] 

According to tlie College Board, however, 
from tlie beginnings of the modern SAl, Carl C. 
Br i ^ham c<U led for a re«isonable perspec t ive 
on tests and t he i r use . Br igham wrote that 
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"to place too j^ruat emphasis .^r test t,cereb is 
as dangerous as the failure proptirly cO evdlua^ 
any score or rank in conjunct i->u with oth- r meas- 
ures and estimates which it supplements." [47:3] 
Throughout the history of l^^e S'\"f , and especially 
since World War II, the CEEB has viewed the in-- 
creasing use of standardized tests as a democra- 
tizing influence in higher education. [47:3] 
By virtue of their accuracy, objectivity, and 
comparability, standardized tests have served to 
identify individuals who regardless of class, 
sex, or ethnicity, are most likely to perform 
successfully in college. [69:2] According to 
George Hanford, Nader and Nairn are trying to 
reorder the nation's college admissions process 
and current system for educational opportunity 
and substitute subjective and undefined valut.r 
of their own for objective measures and a merito- 
cratic approach. (121:2, 4] Hanford suggested 
that Nader's attacks in the guise of criticizing 
methodology and statistical accuracy are essen- 
tially attacks upon the concept of standards and 
quality in education and society. [121:2] The 
standards for college admii^sion should be left 
to the colleges and universities, said ETS presi- 
dent Turnbull. [285:2] 



MInOrlllOS." Nairn reported that an unbiased test 
according to ETS's definition is one that "pre- 
dicts the first year grades of minorities about 
as accurately as they predict the first year 
grades of whites." But this definition, Nairn 
charged, fails to recognize that the validity of 
grade prediction Is low for both groups. [188:112] 
(emphasis In the original) Contrary to the belief 
that admissions st indards are lower for minority ^ 
candidates, Nairn said that they must earn hi,jhk r 
grades than whites in order to have an equal op- 
portunity for admission to college. | 188:1111 
(emphasis In the original) 

Nairn cited a 1971 study of black and white 
students at integrated colleges conducted by ETS 
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researchers Junius A. Davis and Ceorge Temp. 
Ihey reports, that "while the SAT score means 
for (admitted) blacks were lower than those for 
their white counterparts, the mean high school 
ranks were higher." Nairn also cited another 
ETS study of the grades and test scores for all 
applicants to ABA accredited law schools in 1976. 
This study found that 68 percent o"! the whites 
and ethnically unidentified applicants with col- 
lege grade point averages of 2.75 or above were 
admitted to law school, compared to 58 percent 
of the black applicants with identical averages. 
Among applicants with averages above 2.50, 64 
percent of the whites and unidentified students 
were admitted compared to 51 percent of the 
blacks . Since the black app licants ' grades 
ranked as high as the whites, Nairn said that 
the blacks were placed at a disadvantage by the 
results of their ETS aptitude test, not by their 
past performance. [188:111] 

Nairn asserted that ETS maintains that the 
low scores of minorities reflect deficiencies* 
in the preparation of minority candidates, and 
not deficiencies in the tests. [188:111] He 
reported that the low average st_(ires of miiK^rities 
were primarily a reflection of the tests' tendency 
to rank people oy family income. That is, stu- 
dents from high-income families tend to receive 
higher test scores. [188:113] Nairn emphasized 
that it was one thing to tell people that they 
have been victims of less than adequate education, 
but it was something else "to use those scores to 
/rt^i^t'nt iruiividnal,'^ from pursuing opportunities." 
[188:117] (emphasis in the original) While ETS 
purports to lilunnnate educational inequality, 
Nairn sald» in effect, F.TS's aptitude tests 
actually continue it. He noted that as long ago 
as 1969 the Association of Black f\sychologists 
called for a moratorium on standardized testing 
because these tests were the beginning of a 
downward spiral that deprived black applicants 
opportunities for advancement . [118:1 17-J 18] 
More recently. In January 1980, Benjamin L. Hooks, 
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president of tne National Abbocidtion for the \d- 
vancement of Colored People, issued a statement 
calling on Congress to enact truth-in-test ing 
legislaticn to regulate the testing industry. 
Hooks said that regulation was nece&.^ary because 
the testing industry, for the most part, deter- 
mines who goes to college and professional school, 
who can teach, and who can be employed. "Our 
nation can ill afford to allow any private agency 
to limit the opportunity of a child to an educa- 
tion," Hooks stated, "which allows him/her to 
reach his/her potential nor to, through non- 
regulation, foster a system or process which pe- 
nalizes the working ':lass." [131:1] 

While Turnbull acknowledged that black and 
Hispanic candidates consistently achieve lower 
verage test scores than whites, he emphasized 
that it would be erroneous to jump from that real- 
ity to the conclusion that the tests were biased. 
In essence, this would be "blaming the messenger 
for the message." [68:3] Furthermore, ETS said 
countless validity studies have shown that the 
SAT, LSAT, GMAT, and GRE aptitude tests predict 
as well for minority and majority candidates, and 
admissions officials find test scores useful in 
making comparisons among minority students. [75:2] 

Substantial data also show that disadvantaged 
and minority children do not receive equal oppor- 
tunity In American education, Turnbull added. He 
noted that this deticLt increa.->es with the passing 
of time. But "the tests do not create the inequal- 
ity; they reveal it." [68: 3J EJiminating the 
tests would probably not harm candidates with high 
grades from well-known schools, but it would limit 
the chances of maiiy minority and rural students 
whose abilities show up on the tests, *^ut who have 
mediocre grades. [285:2] Likewise, ETS reported, 
there is ample evidence that hese standardi^.ed 
tests help to Identify talented candidates in 
inner city schools, new schools, nontraditional 
schools, and rural schools. College admissions 
officers often cite the usefulness of the tests 
in locating students who have not had the 

ERIC 



advantages and visibility or more affluent 
middle-class students. Standardized tests also 
help to eliminate "bias and inequalities inher- 
ent in grading systems, interviews, and pe'^sonai 
recommendations," according to the testing 
company . [75:2] 

Since the end of World War II, miriority 
groups and people of low socioeconomic status 
have gained increased admission to college . 
Moreover, a high percentage of all candidates 
for college admission are admitted to the college 
of their choice. Turnbull said that, extrapola- 
ting from this trend, it would be difficult to 
conclude that standardized tests have barred 
college doors to minority students and the dis- 
advantaged. [68:3-4] Accorcing to Hanford, the 
Na^ rn report implies th-^t minority candidates 
are routinely being denied admission to college 
On the contrary, said Hanford, between 19 70 and 
1977 the enrollment rates for whites remained 
faiily constant, while the "enrollment rates 
for black and Hispanic students rose by five per- 
cent and six percent, respectively. [121:5] ETS 
added that the evidence presented to the U.S. 
Supreme Court in the Alan Bakke case (Clearly 
indicated that test scores are used to identify 
potential talent and that ninority candidates 
with above average, average, and below average 
test scores are being accepted into prestigious 
law and medical schools. [75:2] 

LTS further criticized Nairn's report for 
not devoting attention to the role of the Col- 
lege Board in advancing the concept of awarding 
financial aid based on need, ignoring ETS's fi- 
nancial aid need analysis program at the graduate 
and professional school level, and overlooking 
many talent search , guidance , scholarship , and 
demonstration projects designed to ameliorate 
educational opportuni ties tor d it' advantaged and 
minority candidates. \7f>:lO\ ETS affirmed that 
it is committed to addressing the "causes of dif- 
ferences in educational achievement" for both the 
disadvantaged and the affluent. ETS reiterated 
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that Nairn had ignored important research activi- 
ties which involve ETS such as the following: 
(1) a five-year study of compensatory reading 
programs in grades 2, 4, and 6, (1) a longitu- 
dinal study of disadvantaged students and their 
initial school experiences; (i) studies of exem- 
plary school desegregation practices; (4) evalua- 
tion studies on the effects of educational pro- 
grams, such as Sesame Street, and the programs' 
influence on the skills and achievement of dis- 
advantaged children; and (5) a number of evalua- 
tions of compensatory education projects conducted 
at the local level. [76:11] 



Ta«t scores and Income. — standardized tests, 

Nairn stated, have not replaced ranking baaed on 
economic class with ranking based on merit. The 
so-called "democracy of multiple-choice tests," 
he contends, remains largely a ranking of people 
by family income. [188:198-199] Not only do the 
ETS test scores discriminate between the rich and 
poor, Nairn said, but they also discriminate be- 
tween the rich and a na^iorifj of Americans, the 
working class and the middle class. {188:200] 
(emphasis in the original) 

Nairn observed that "the more money a per- 
son's family makes, the higher that person tends 
to score." (188:200) The -anking by class is 
pr<^'valf'nt not only when large groups are averaged 
together but also among applicants to Individual 
colleges. [188:202] This pattern appears to be 
consistent over geographic regions and Income 
levels, Nairn added. A 1973-74 CoJ lege Board re- 
port cited bv Nairn showed, for example, that stu- 
dents with the hUhest SAT iverage (750-300) had 
an average family income of S 24, 124 compared to 
students with the lowest SAT average (200-249), 
$8,6')9. (See Table 7.) More recent data on the 
test scores and family iacwmes for candidates in 
1978-79 revealed a similar pattern. For t\w 
applicants averaging below 330 had a mean familv 
income of $18,400, while those averaging 650 or 



more had a mean income of $33,400. [188:201, 

203] 

Citing figures compiled by Humphrey Uoerraann 
for a College Board colloquium, Nairn reported 
that a student from a family earning les-j than 
$4,600 in 1969-70 income had a 10 percent chance 
of scoring above 450; the chances increased to 
21 percent in the $7,500 to $10,699 range; and 
they quadrupled to 40 percent in the $16,200 range 
and above. [188:203] Nairn concluded that if ETS 
scores measure a person's "merit," then merit in 
the United States is allocated according to t<4;aiiy 
income. [188:204] 

KTS asserted tnat Nairn's report distorted 
the facts concerning test scores and family in- 
come . EIS said Nai rn 's allegations that the com- 
pany had suppressed information concerning the 
relationship of test scores to students' family 
incomes, that SAT scores and family income rank 
students nearly the same way, and that the tests 
are used to preserve a social status quo, were 
all untrue. :6J 

According to EIS, the data which Nairn used 
came fron a series of reports, published by the 
College Board since 1971-72 and distributed to 
over 15,000 institutions and individuals. Al- 
though these data show that students from fami- 
lies with higher incomes tend to receive higher 
test scores, students from each income level ob- 
tained the full range of SAT scores. Also, nearly 
one- third of the candidates with family incomes 
below $6,000 ranked in the top half of the entire 
group in terms of SAT scores, [76:6] Thus, 
claims KIS the ut-e of admission tests has contri- 
buted substantially to increased access of poor 
and working class students to higiier education. 
[76:6] "It would be tragic if exaggeration (^f 
the re latum between at'- r<ij> inrome and m^/^ 
test scores were to lead to unfounded pessimism 
among able low -income students oi their parents 
about thel r chances of doi ng we 1 1 on tests," 
wrote F.TS ' s lurnnull. (emphasis in tlu* original) 
"And despite claims t(> the contrary, it is still 



48 



a fact that test scores correlate more highly 
with grades than with family income." [68:4] 
Table 9 shows the average SAT scores and re- 
ported family income for coll L»-bound seniors 
of 1973-74. 



Prtdfctlon of first year grades.— "The ability 

to predict grades," Nairn stated, "is the empir- 
ical basis of ETS's claim to measure aptit;^ude." 
[188:58] ETS has maintained that countless stud- 
ies have shown that the SAT is an effective pre- 
dictor of college performance. Yet, Harvard 
Medical School researchers Slack and Porter 
contend that their research indicates otherwise. 
They reported that a summary of validity studies 
between 1964 ard 1974 (Ford and Campos, 1977) 
indicated that the SAT validities for males and 
females combined averaged about .40 for the SAT-V, 
.35 for the SAT-M, .50 for the high school record, 
and .58 for all three predictors combined, i.e., 
the SAT provided an increase of .08 over the high 
school record alone. [258:165} Slack and Porter 
said that their own arithmetic, based on the data 
provided by Ford and Campos, showed that the SAT 
validity coefficients were smaller. [258:166] 
Table 10 shows the median validity coefficients 
of combined-sex samples for the SAT-V, SAT-M, 
high school record, and combined predictors, 
1964-74 as reported by Slack and Porter. 

According to Slack and Porter's analysis of 
the 1964-74 data, the validity coefficients are 
.37 for the SAT-V, .32 for the SAT-M, .52 for the 
high school record, and .58 for the three predic- 
tors combined. Thus, the validity coefficients 
of the tests, togethet with the high school rec- 
ord are only .06 greater than the high school 
record alone. [258:166] While noting that the 
SAT's contribution to the prediction of first- 
year grades largely depends on how the validity 
coefficients are Interpreted, Slack and Porter 
stated that, in general, the SAT adds littl^^ to 
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the prediction of coL'^^^ grades over the high 
school record alone. [166:lr)7i 

Although the Slack and Porter studv employed 
different statistical techniques in its analysis 
of the predictive validity of the SAT, the Nairn 
study found similar results in its analysis of 
the Ford and Campos data. [258:167] Specifically, 
Nairn reported that, according to figures 
gathered from 827 different ETS validity studies 
conducted between 1964 and 1974, the SAT delivers 
a "percentage of perfect prediction" of 11.9 per- 
cent in predicting first-year grades. [188:60] 
Other ETS aptitude tests provide similar percent- 
ages of perfect prediction: 13 percent for the 
LSAT, 11 percent for the GRE, and eight percent 
for the GMAT. [188:61-62] Nairn said that in 
order to determine how often chance would pre- 
dict grade ranking within a group as well as an 
ETS aptitude test, the tests' percentage of per- 
fect predic::ion is subtracted from 100 percent , 
[188:64] Nairn's calculations show that the 
SAT scores, on the average, predict a candidate's 
"grade rank no more accurately than a pair of 
dice." [188:65] Furthermore, since SAT test 
scores are not the only factor in admissions 
decisions, Nairn asserted that their effective 
contribution to grade prediction is less than 
12 percent. [188:65] 

Additionally, Nairn said that data from the 
1964-74 validity studies showed that including 
SAT scores in the prediction process improved 
the prediction of college grades by ^live percent 
or less. "This thin margin, the extent to which 
ETS scores improve the prediction already offered 
by previous grades," Nairn emphasized, "is the 
single thread, the single rational function, from 
which the ETS aptitude testing empire hangs." 
[188:66] Nairn stated that ether forms of assess- 
ment such as biographical questionnaires, personal 
rating scales, persistence in staying in school, 
previous accomplishments, and other Information 
have been found to predict first-year grades 
nearly as well or better than test ftcorCvS. [188: 
68, 72, 77] 
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TABLE 9.— 1973-74 College Bound Seniors Classified 
by SAT Average and Family Income* 



Reported Family Income 



SAT 


$ 0- 


$6,000- 


$12,000- 




Average 


Average 


5,999 


11,999 


17,999 


^^18,000+ 


income** 


750-800 


17 


117 








700-749 


239 


1,172 


1,752 


3,252 


21,980 


650-699 


686 


3,994 


5,683 


9,284 


21,292 


600-649 


1,626 


9,352 


12,187 


17,992 


20 , 330 


550-599 


3,119 


17,042 


20,822 


28,151 


19,481 


500-549 


4,983 


26,132 


29,751 


37,400 


18,824 


450-499 


6,663 


33,209 


35,193 


'41,412 


18,122 


400-449 


8,054 


34,302 


33,574 


37,2j3 


17.387 


350-399 


8,973 


29,762 


25,724 


26,175 


16.182 


300 - 349 


9,622 


21,342 


14,867 


13,896 


14.:^5 


250-299 


7.980 


10,286 


5,240 


4,212 


11,428 


200-249 


1,638 


1,436 


521 


325 


8,639 


Total 












Number 


53,600 


188,146 


185,483 


219,727 




Ave rage 












SAT Score 


403 


44 7 


469 


485 





The cotcii number of students in this table (646,956) 1.3 var> -lightly smallar than the number 
(647,031) included in the analyses reported in College Bound Seniors^ 197Z-74, Students in this 
talb^ must have had both SAT verbal and SAT mathematical scores and have reported family Income on 
the Student Descriptive Questionnaire. Students with only one SAT score were included in College 
Bound Seniors. 
** 

From College Bound Seniors, 2972-74. 

SOURCE: Teet Scores and Family Tnpome. Princeton, NJ: Educational Testing Service, 1980, copyright 
1980 by Educational Testing Service, 1980. p. 7. Used with permission. 



According to Rex Jackson of ETS in an arti- 
cle appearing in the August 1980 Harvard Educa- 
tional Review^ Slack and Porter ignored the sum- 
mary table in the Ford and Campos report and 
selected one sentence from the text which dis- 
cussed only a portion of the data, which Slack 
and Porter then contrasted with their own find- 
ings. Jackson called the Implication that the 
Ford and Campos results had been reported inac- 
curately "a serious injustice to the authors." 
[134.1:3891 

In response to Nairn's charge that rolling 
dice is nearly as good as using test scores in 
the admissions process, ETS charged that Nairn's 
claim vas based on faulty statistics. [77:16] 
ETS reported that Nairn used an incorrect value 
for the characteristic validity of the SAT 
(.345), which is the average of the separate 



validities of the verbal and mathematical parts 
of the SAT. Nairn should have used the greater 
predictive validity 'of the total test which is 
.41. After taking an erroneous validity of the 
SAT, Nairn squared the validity coefficients and 
multiplied the results by 100, thas arriving at 
the numbers 13 for the LSAT, 12 for the SAT, 
11 for the GRE, and 8 for the GMAT. [77:16] 
Then, by taking the complements of these num- 
bers, Nairn stated that "rolling dice will be 
as accurate as using test^.scores from 87 to 
92 percent of the time." [77:16] ETS said it 
was not possible to know how Nairn reached this 
"misconception.** [77:17] ETS emphasized that 

If the SAT were valid, it would be 
no Worse than a random predictor, such 
as a pair of dice. If predictions based 
on an invalid test and random predic- 
tions were compared for a large group 
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TABLE 10.— Median Validity Coefficients of Combined~Sex Samples 
for the SAT-V, SAT-M, High School Rej;;ord (HSR), and 
Combined Predictors, 1964-7^ 

















Increase 






Number of 








Comb i ned 


over HSR 


Source of Date 


Year 


Colleges 


SAT-V 


SAT-M 


HSR 


Predictors 


Alone 




1964 


L. O 

DZ 




. JZ 


. J J 


.0 Z 


07** 

• V/ / 




1965 


80 


.36 


.29 


.56 


.61 


.05 




1966 


76 


.33 


.28 


.5 3 


.5 7 


.U'4 




196 7 


62 


.36 


.28 


.52 


.57 


.05 


Ford & Campos 


1968 


41 


.40 


.33 


.56 


.62 


.06 


1969 


45 


.39 


.33 


.53 


.59 


.06 


(1977, Table 5, p. 9) 


1970 


129 


.37 


.29 


.49 


.56 


.07 




1971 


32 


.34 - 


.28 


.48 


.53 


.05 




1972 


101 


.35 


.33 


.50 


.57 


.07 




1973 


89 


.38 


.36 


.50 


.56 


.06 




1974 


110 


.42 


. .39 


.50 


.58 


.08 


Ford & Campos Storanary^ 






.40 


.35 


.50 


.58 


.08^ 


(1977, p. 3) 
















Slack & Porter's Calcula- 
















tlons^i fron Ford & Campos 






.37 


.32 


.52 


.58 


.06" 


(1977, Table 5, p. 9) 

















^These are our figures, calculated from Ford and Campos (1977) by subtracting the median 
validity coefficients for the high school record alone fron the median validity coefficients for 
the combined predictors ( comb in'^d- sex samples). 



^These are the "averages" for the SAT-V, SAT-M, HSR, and combined predictors presented b^ 
ETS in the Ford and Campos summary (1977, p. 3). 

^We calculated this increase over the HSR alone by subtracting the "average" for the. HSR 
alone (.50) from the "average" for the combined predictors (.58) (Ford & Campos, 1977, p- ^) • 

^These are welgnted means; we calculated them from the median validity coefficients reported 
in Table 5 of Ford and Campos (1977, p. 9). In the absence of information on the number of stu- 
dents in each sample, we assumed that the number of students was proportional to the' number of col- 
leges and used the number of colleges for each year as the weighting factor for that year's valid- 
ities. For each variable, our calculations of the weighted mfeans, means, and medians of the median 
validity coefficients (in that order) are as follows: SAT-V = .37, .37, .37; SAT-M = .32, .32, 
.32; HSR - .3?, .32, .52; Combined Predictors « .58, .58, .57; increase over HSR-^ = .06, .06, .03. 

^We calculated this increase over the high school record alone by taking the difference 
tween the weighted mean of the median validity coefficients of the high school records (.52) and 
the weighted mean of the median validity coefficients of the combined predictors (.58). 

SOURCE: Slack, Warner V. and Douglas Porter. The Scholastic Aptitude Test: A Critical 
Appraisal," Harvard Educational Review, May 1980, p. 166. Copyright 1980 by 
President and Fellows of Harvard College. Used with permission. 
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of Students, the test would give predic- 
tions closer tc students' obtained CPAs 
for about 50% of the cases, and random 
predictions would be better for the other 
50%. Predictions based on valid informa- 
tion will be better than random predictions 
and will certainly moi'e closely approximate 
obtained CPAs ror more than 50% of the ap- 
.plicants. Yet, according to Nairn, dice 
will be as good as or better than the SAT, 
a test of proven validity, 88% of the time. 
Like citations of evidence in the Wairn re- 
port, these dice should be carefully 
inspected, (emphasis in the original) 
177:17] 

ETS further stated: 

Iiv arriving at a figure of five percent, 
which in his chapter title he calls "five 
percent of nothing," Nairn switches statis- 
tics from r2 to another ind^x. In fact, he 
uses . . . the "coefficient of forecasting 
efficiency, which is equal to 1-1^-r^ 
The actual coefficients for the 1974 data 
(not reported by Nairn) are 13.4 for high 
school grades alone and 18.5 for tests and 
grades combined, which do indeed differ 
by 5.1. This index has a theoretical 
range from 0 (for random prediction) to 
100 (for perfect prediction) and can be 
interpreted in percentage terms, though 
the interpretation is not a particularly 
simple one. Since ''perfect prediction" 
cannot be attained, it is reasonable to 
consider the contribution of tests in re- 
lation to the level of prediction offered 
by grades alone. Simple arithmetic (5.1 
divided by 13.4) indicates thit combining 
test scores with grades increases the 
value of Nairn's chosen index by 38%, 
not 5%. (emphasis in the original) 
[77:19] 

George Hanford of the College Board reported 
that Cameron Fincher's 1974 report oi. the use of 
the SAT in the university system of Georgia, which 
included 19 institutions over a 13-year period, 
found an average correlation of SAT scores with 
first-year college performance of .49, on a scale 
of 0.00 to 1.00 (perfect prediction). This study 
also showed that while high school grades arc a 
better predictor with a correlation of .54, the 
combination of SAT scores and grades together 
Increased the correlation to .65, "a strong in- 
cremental addition to the validity of the predic- 
tion." Hanford reiterated that the SAT is only 
one element in the admissions process, which oftt 



includes interviews, activities reports, and let- 
ters of recommendation. "The question is not 
whether the ShT is perfect," Hanford baid, "but 
whether it is useful." [121:3] 

Testing the tejtS.-- Because the consumers of 
education tend to accept unquestioningly the 
psychometrician*s claims about aptitude tests, 
Nairn charged that ETS's clainis about its tests 
constitute "a specialized variety of fraud." 
[188:58] This "fraud" appears to be respectable 
because it adheres to the rules of the psycho- 
metric profession anjl because political and 
economic institutions have been receptive to t-he 
test makers* verdicts aboXit individuals* poten- 
tial, Nairn stated. [188:58] Over the past 30 
years, Ralph Nader estimated that the "pervasive 
power uf ETS" has probably affected sone 90 mil- 
lion people who have had their educational and 
occupational prospects shaped by its standarized 
tests. [184:1] Nairn contended that ETS should 
not be permitted to define consumer choices in 
terms of its tests nor should it "be given an 
intellectual monopoly to complement its economic 
one." [188:382] Further, he stated that reliance 
on multiple-choice tests unfairly restricts "the 
means b> which individuals can demonstrate their 
skills and potential," [188:384] and that the 
tests can also hinder the development of essay 
writing and scientific problem-solving skills. 
[188:386] Nairn further stressed that the tests, 
when validated against first-year grades, "im- 
prove efficiency of prediction by an average of 
only three to five percent." [188:388] He also 
questioned the rationality of ranking applicants 
"v/ith tests that provide only an eight to 15 
percent improvement over blind chance in predic- 
tion of a short-term criterion such as first- 
year grades." [188:391] Nairn empha.sized that 
standardized tests cannot purport to measure the 
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variety of skills necessary for success in any 
academic or post -academic endeavor. [188:391] 

Nairn charged tnat ETS has an overwhelming 
economic and political interest in maintaining 
the current testing system. In order to maintain 
. this system and defend its existence, F rs i cis 
developed an extensive and subtle network of in- 
fluence. This influence extends to the upper 
reaches of government, wbere ETS has had associ- 
ations with four Commissioners of Education from 
1962 to 1972. It also extends to about 2,000 
paid consultants at thousands of universities, 
colleges, educational asso lations, and local 
school districts across the country. [188:396] 
Nairn believes that reforming the test system 
must focus on ETS, the organization which devel- 
opi> and administers tests for thousands of in- 
stitutions. Both Nader and Nairn asserted that 
they plan to take a leading role in the "na- 
tional examination of the examiners." [188:384] 
Part of their upcoming agenda will feature the 
following considerations: 

• '*What are the effects of restricting the 
information system. . . to muLtiple-choice 



The Commissioners of Education Included 
Francis Keppel, 1962-66, former president of the 
Carnegie Foundation for the Advancement of Teach- 
ing, a founder of ETS; Harold Howe II, 1966-68, a 
former College Board trustee, and vice-chairman 
of the College Board's Advisory Panel on the SAT 
score decline; James E. Allen, 1969-70, who served 
as a consultant to ETS; Sidney P. Marland, Jr., 
1970-'72, former president of the College Board and 
a trustee of ETS. Other prominent government of- 
ficials with whom ETS has had associations include 
John Gardner, former president of the Carnegie 
Foundation, former ETS trustee, and former Secre- 
tary of Health, Education, and Welfare; Juanita 
Kreps, former ETS trustee and U.S. Secretary oi 
Commerce; Willard W. Wirtz, former U.S. Secretary 
of Labor, and chairman of the College Board's 
Advisory Panel on the SAT score decline; former 
U.S, Congressman John Brademas, a former ETS 
trustee and former head of the House Subcommittee 
for Higher Education; Ernest Boyer, former U.S. 
Commissioner of Education, and president of the 
Carnegie Foundation; Shirley Hufstedler, former 
Secretary of Education, who served as a trustee 
of the Aspen Institute for Humanistic Studies, 
vhich has its international division lotated at 
ETS headquarters « 

o 
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tests developed and chosen by a single 
organization?" [188:384] 

• "What are academic and other institutions 
trying to accomplish with their admis- 
sions policies?" [188:387] 

• "Pre'ciboly whdt gc>cils and whose inter- 
ests do those policies actually serve?" 
[188:387] 

• "Should applicants have to bear the cost 
of the tests?" [188:389] 

• "Is the ETS ranking really a meritocratic 
ranking?" [188:390] 

• "What is the purpose of demanding that 
alternative admission standards r<ink 
candidates in a similar fashion?" 
[188:390] 

• "Can significant reforms be implemented 
given ETS* current position?" [188:394] 

ETS, on the other hand, asserted that it ha§ 
worked diligently to help both candidates and in- 
stitutions keep test scores in perspective. Al- 
though test scores are only one factor in the 
admissions process, many critics of testing have 
ascribed to them an importance that is substan- 
tially out of proportion, Turnbull said. [68:4] 
When testing critics publicize this fallacy, 
Turnbull added, they increase the likelihood of 
"test anxiety" among students, encourage others 
to seek expensive coaching schools, and instill 
an unfounded belief in high-scoring students that 
their test scores will earn thetn admission to the 
institution of their choice. [68:4] 

Standardized tests, Turnbull emphasized, are 
the same for all candidates and reduce the unfair- 
ness t It would result if college admissions of- 
ficers reviewed only high school grades, which 
vary considerably among schools and teachers. 
[285:2] ETS stated, however, that personal 
qualities such as judgment, wisdom, creativity, 
idealism, staminc, and determination are highly 
valued and sought, but they are difficult to assess 
in other than subjective terms. [77:24] 
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EIS baid th<ir it has no quarrel witti Nader 
and Naira proposing their view^ regarding eritc- 
ria useful Ln makm^; admissions decisions. But 
these views should not be considered the only 
correct values nor stiould they "be substitutea 
for the (onsLdered judgment of the facuUius 
and administrators of the educational institu- 
tions." |77:-Z5j There are ample opportunities 
to contribute to thoughtful deb<ite <iad improve 
testing in the admissions process » EiS observed; 
hot/ev«r» tiu- Nairn report offered "no serious 
alternatives" and misrepresented many facts. 
[77:251 

The proper response to the carapait;n <igainst 
testing and inst itiit ion il auLonomy, according to 
Hanford» . ought to r.or*» I roni prt> f es s i'>nal ^ 

in guld.inte and admi i '^^ns , -v^ho are involved in 
and are best informed i .at the programs and 
services under criticism. [1^1:5-6 J Hanford 
accused N'lder of "re< kle.^s and mf 1 amma torv at- 
tacks" whi<Ti infer that the "purpose of these 
^J^JL^^ JPi:LriL'^'5 jUI ^ "J ^ 19 i:J i sys tern 

i^l' ^ L^L^ to tlios e_ who ngh t ly 
soek^them." (emphasis in the original) [12l:bJ 
Furthermore^ rerentlv introduced legislation 
to regulat*,* testing', nat i nrui 1 1 , Hanford Eioted» 
could mean the demise of account tbility pro- 
grams <ind pro(hice i ripple effect which could 
spread frt^m admis.it^is tests, to lompetent^y 
tests» measuro'-, of ,n < >unta[) 1 1 t t ' » bar exauuna- 
tions, ( ivil -,^>rviif» x^imi na i i ()n-> , jnd even 
driving te<~ts. Hanford reitt. rated tiMt 

the SAI is not a perte^tlv ac urate sire<liLtor» 



but wtien it is rombined with high school graii^ts, 
It provides tlie best predictor known. [I^Jioj 
"A nation mat throws out its tests a^ Ka i ph 
Nader would have us do," Hanford (auiuuu'd, "is 
m danger of th^rowmg out both its values uui 



its standard-^ 7' [lJ5:^i] 

In <in adpress to the 



Middle States \ssocia- 
tion of Collej^e^ c^nd Sch(}ols in Det. ember of I97y, 
Hanford posed the^e questions to his audiei.' e 
for eons ider<it ion: 

• "Wnat a:'', the viable alternatives tc> ad- 
missions tests'" (emphasis la tne v^rigi- 
nal) (123:L0J 

• "How mucii doe^5 your institution rel oa 
tests, and test scores. . . m tr.e guid- 
ance process if it's a scho<3l. . . or 

in the 'idmissions process if" it's a 
college^" 1U3:10J 

• "Siiould we, and if s^ how ^.ould we. . . 
\v>ur schools and colleges a^ Institu- 
tions. . . or the Middle States \s soci- 
al t ion ctiid the (X)iiege iiuaid as <^rgafii- 
zation.s, , , better respo[id to tlie con- 
cerns ot the consume r movement 
ll.>3.lUj 

• "Should we ' and if so ho^ can *t ."' 
beeoiPe m(»re <ic Ciuin tab 1 e , or porliaps, how 
win Wf hring about <i hetLer perceptum 
"f oar ai ca)un tab I 1 1 ty ^ " (e^phr*sLs m tiie 
oruiual ) 1 IJ3' 101 

• "( in there be standards without 
assessments '" (1^3: It) J 

• ' rthat I •> tlie iiii n 1 niim--whe rt is Lot 
1 loot I iJi: iO] 
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THE COACHING CONTROVERSY: 
SPECIAL PREPARATION FOR THE SAT VS. NO SPECIAL PREPARATION 



The highly publicized decline in SAT test 
scores is one reason for increased interest in 
the effects of coaching on the SAT and other 
standardized admissions examinations. [136:9 J 
Many educators and much of the public believe 
that coaching can make the critical difference 
in gaining ^^mission to college and graduate 
school. Scoring well on a standardized admis- 
sions examination is very important for those ap- 
plying to a prestigious college or university. 
More than 90 percent of those admitted to Princeton 
University, Smith College, Stanford University, 
Wellealey College, Brown University, the Univer- 
sity of Chicago* and the Massachusetts Institute 
of Technology score over 500 in both the SAT ver- 
bal and mathematical tests. [90:11] 

In addition. Harvard requires students to 
score between 500 to 800 on each test; Y^Ie re- 
quires students to score a minimum of 670 on the 
SAT-V and 680 on the SAT-M; both Pennsylvania and 
Columbia Univetsities require scores of 650 on_ 
the SAT-V and 660 on the SAT-M; Pennsylvania State 
has an acceptable range of scores between 450-600 
on each test; Emory requires a 550 on the SAT-V 
and 600 on the SAT-M; Rutgers 490 on the^SAT-V 
and SAO on the SAT-M; and George Washington Uni- 
versity, *a combined total of at least 1,000. 
(194:35] The 1980 SAT score averages for 

In 1980 the College Board reported that 
only 5.5 percent of all SAT takers or about 5:), 000 
atud«nt8 had a SAT average of 500 or higher and 
parents who could contribute $5,000 or more to 
their college education. [6.2:8] 
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college-bound seniors were -^424 von the SAi-V and 
466 on the SAT-M, a total cT 890 points out of a 
maximum of 1,600, [6,2:5] 

According to test criLlc Allan Nairn, it 
has been esti^sOied that as maay as 40 percent of 
the nation's public colleges and 20 percent of 
private colleges use test scores as automatic 
cutoff points. [35:190] As more individuals 
seek coaching to improve their test scores and 
their chances of admission to select colleges 
and universities, the debate over the effective- 
ness of coaching for the SAT and other tests will 
continue to escalate. 

The CoUegt. Entrance Examination Board, on 
the other hand, maintains that interest in spe- 
cial preparation or coaching stems from an exag- 
gerated view of gaining admission to college at 
the undergradtiate level. Test scores are only 
one component in the admissions process along 
with high school transcripts, letters of recom- 
mendation, previous experiences, and activities. 
(50:1] Traditionally, the CEEB has claimed that 
the SAT measures abiJitles developed over a life- 
time. As a result, the College Board believes 
that the SAT is not susceptible to c^iort-^ erm in- 
St ruct ion, spec ial prejjaration, or coaching. 
[122: 1» 3t The coaching issue is complex because 
the term "coaching" can refer to several types of 
test preparation. [66:1] Added to the complexity 
in understanding the effects of coaching io that 
students ' ^est scores change over time due to 
growth in verbal and maLhenaticfil reasoning abil- 
ities and "a lack of perfect precision in the 
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m^surlriK Instrument." The College Board hd^> 
Intimated that students* verbal and matliematic.il 
ja^ores will Increase approxLmcitt?ly 15 to 20 
points each between the spring of a student *s 
junior year and the winter of his or her senior 
year. Additionally, about five percent oi all 
students will notice a score increase of approx- 
imately 100 points or more, while one percent 
will experience a score decrease of a similar 
amount regardless of whether special preparation 
for the SAT Qccurs. [50:2] Earlier studies of 
coaching, or special preparation that included 
control groups, according to ETS, resulted in 
test score gains of less than 10 points for the 
verbal portion of the test and less than 15 
points for the mathemaf ical portion of tl»e test. 
(177:3] 

In a 1965 statement that was essentially un- 
changed until 1979, the College Board said: "In- 
tensive drill for the SAT, either on its verbal 
or i»:s mathematical pari, is at best likely to 
vield insignificant increases in scores." [50:1] 
But in light of two reports released by the Fed- 
eral Trade Commission and growing criticism di- 
rected toward standardized testing in general, 
test agenclet> nave b^'pjin to make subtle and po- 
tentially important adjustments. In the past the 
College Board applied the term "coaching" only to 
intensive drill or "cramming" on sample te«t ques- 
tions. i'^0:2] Yet refont statements frotr. thp 
(ollege Board point out that cramming is not the 
same as "formal instruction in reading, comprehen- 
sion '^nd verbal .md machem<it i cal concepts," and 
.'rj>pt^'','}'n- Iv'l' is likelv to have little effect; 
well designed, lo*uh r \ ^^r: avatlnn can have greater 
efftHt." (i>-nphasis in tlie original) [122:3-'^] 
Cf^or-^e H.intnrd, president t^f the College Board, 
i^bserved th.»t "when something steeps hein^'> short- 
term tramming and becomes long-term tutoring, 
there .s a di -it l o' t i vUJ . " |lbH:lll| \1 though 
largely a matter ot serianti(s, this fine distinc- 
tion, a< cording »■ o iine etlut u 5 on writer, mav 
eventJiallv lead ?o an a^k iu>w Ictigment hv testing 
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agencies that coaching is effective in some cases. 
[136:9] Critics of standardized tests go further, 
and claim ttiat if coaching improves test scores 
substantially, then the SAT does not measure one^s 
aptitude or intelligence. [188:^^] 

Commercial Coaching Schools 

The test-coaching industry is growing at an 
extraordinary pak,e. There are few state licens- 
ing restrictions and almost no entry barriers to 
this industry. [90:36] In 1976 commercial coach- 
ing schooltr^spent $400,000 on advertising, and 
nationwide sales yielded approximately $10 mil- 
lion. [90:31] According to Foi'hi^c magazine, 
commercial coaching in 1979 grossed ^60 million. 
[293:21] Approximately 50,000 students enrolled 
in coaching schools in 1976. [90:31] Tuition 
charges range from a minimum of $40 to a maximum 
of $500. [90:31-32; 194:26] The nationVs largest 
commercial coaching enterprise, the Stanley H. 
Kaplan Educational Center (SHK) , began over 30 
years ago, enrolls more than 30,000 students 
annually, and it^, 19/8 sales reached $9 million. 
[lb8:Ell; 237:1, 20] 

Commercial coaching schools vary consider- 
ably in their curricula, instructional methods, 
and course materials. Tlie coaching curiTicula 
m^iy include teaching tcst-wiseness and exam tak- 
ing techniques^ short-terra instruction which in- 
cludes substantive content, or intermediate-term 
instruction. At tlic Columbia Test Preparation 
' .titute students review analogy questions and 
are taught to recognize "reverse meaning," 
"worti association." "ungrammat icai answers," and 
tv'* avo id i nappropr late .inswers . I n orde r to 
di.pLi student anxiety, anotlicr school, the 
Se <ton Ci'nti^r, offers remedial math<Mii.it 1 1 s \\v 
struct ion in addition t<i its regular pr<n;i''J»^^ • 
Other eo<n.hing iMiterjir i ses ^ut h as I tie Liuulaiue 
(eiUer in Santa Monua, (,a 1 i 1 <^rn i a , and the Dulac 
Stiiool in New York Citv piovidt-^ " pui i v i dua 1 i /ed 
counseling and ps yrho I ic ai reassurance." 
|.'37.l, ?()] 
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Coaching schools utilize written materials, 
commercially available review books, and self- 
designed review l>ooks and nraterials. SHK also 
has a tape library which offers students about 
200 hours of additional review. [90:32] The 
Heights Study Center of Washington, D.(k., offt^rs 
students 20 hours of classes equally divided 
into verbal and math sessions with 50 hours of 
homework. Students who maintain a perfect hoipe- 
work^at cendance record but fail to add 100 ooints 
to their previous combined verbal-math score are 
entitled to a 70 percent refund or a full tuition 
scholarehip at a subsequent session. [124:2] At 
the larger preparatory schools, staffs of re- 
searchers are constantly updating and writing 
practice questions. Several coaching schools, 
however, apparently pay individuals to take 
standardized examinations tor the purpose of 
remembering the test questions. [90:32-33] Upon 
learning that some questions appearing in a 1978 
edition of the SAT were identical to questions 
distributed in a private coaching course, ETS 
filed a copyright suit and was awarded $15,000 
in damages against Tuchman Tutoring Service of 
ilartsdale. New Yo^f^. Students who had access to 
•the test questions had their scores cancelled. 
[27^:2] 

Boston Regional Office Report on the 
Effects of Coaching on Standardized 
r Admission ExaminatiQns 

On October 13, 1976, the Federal Trade Com- 
mission (FTC) directed Its Boston Regional Office 
iBRO) to conduct an investigation to determine if 
test preparers, review courses, coaching schools, 
Arsons, or partnerships, were en^ai^ed in unfair 
or deceptive practices affecting ctJmmetce. In vi- 
olation of Sectiji 5 of the Federal Trade Cg*imis- 
slon Act. [90:51 Arthur ^. Levine, BRO staff at- 
torney, headed the investigation to determine 
whether teyt preparation centers bad a reasi^n.-ib le 



basis for their claims that s^oros on standard- 
ized tests could be increased to the amount ad- 
vertized. [90:6] Some examples of claims made 
b'^ coaching enterprises were: 

• "Tlie t^cores of many of our students have 
jumped 250 points or more." [90:171] 

• "The average increase of students who 

I take our cours'^ is 80 points with some 

\ 

improving as. mi^ch as 150 points." [90; 
173] 

• "...If an average improveroe nt ,of 30 
points results merely from having taken 
the test before, a still greater score 

^ ^dvantage would be expected to follow an 
effective instructional program..,." 
[90:173] 

The BRO study was one of the largest coach- 
ing studies ever undertaken and one oi -the few 
studies devoted to investigating commercial 
coaching enterprises. Since there were problems 
in identifying defunct coaching schools, inade- 
quate record retention by the schools, and fewer 
numbers of students enrolled in preparation 
courses prior to 1974, BKO's investigation was 
limited from October 1974 through December 1976. 
Nonetheless, the period covered offered BRO's 
staff the large sample sizes necessary to conduct 
a statistical inquiry. [90:26, 28] The sample 
consisted 3f 2,741 students, which included 
1,7 38 who were uncoached and 1,003 who were 
coached. [113:1] The investigation was limited 
to the Scholastic Aptitude Test and the Law 
School Admission Test, [90:27] With regard to 
the SAT, two commercial coaching enterprises 
Were studied, the Stanley H, Kaplan Educationai 
Center (called School A) and the X si Preparation 
Center (called School b) , [113:1] SAT coverage 
was confined to the New York area, b^it the LSAT 
coverage included coaching schools in Boston, 
Chicago, Los Angeles, and New York. [90:50*] 

The Boston Regional Office observed that 
there were two methods Cor determining tho et- 
fect^ o\ Loaching upon SAI and l.SAT scores: 
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(I) conducting a controlled t'Xt)L'r iniunt and {2.) 
Londucting an experiment: u^mg exist in)^; condi- 
tions. (90:46] Although an experimental ap- 
proach was prt'ferablt', the BKO feit that it would 
bt^ expensive, t ime-consum i n^-; , and require den\in^ 
students access to commercial cojchin^. [90:481 
Consequently, the BKO study employed a nonexperi- 
'nental design. students beira', examined were not 
randomly assigned beforehand to either a coached 
or noncoached group. [113:1] 

A baseline was established to compare coached 
students against noncoached students. PSAl scores, 
provided the SAT baseline, while undergraduate 
CPAs provided the [.SAT baseline. These baselines, 
aLLording to HK(J vere selectee because of tlieir 
availability, conve.nence, and reasonableness. 
Krom these baselines, expected average test 
scores were generated for both coached and un- 
coached students. Comparisons of these average 
sc'-^res were then used to analyze the practical 
effects of commercial coaching. [9o:59] BRO, 
however, cautioned that the uncoached, or con- 
trol groups, may not have been completely gleaned 
of all coached students because some students may 
have <it tended an unidentified coaching school, 
mav have experieiiLed intensr'e se 1 f-preparat lon , 
or may ha^' -cen ccoached by ^he nonprofit portion 
ot the coaching industry. [90:60-61^ 

BKo's statistical an.ilyses for SAT takers 
who were coached in the period intervening be- 
tween the PSAF and the SAT, and who took the SAT 
oni\ ohlC, induated that: 

• Averr<?e verba! SAT inere.ises attributable 
to School A*s Coaching ranged from 40 t 
76 points abcjve the uncoached group. 
Students who scored higher on the I SAT 
receivec' the greater bene! Its. 

• Average math S.\T increases in School A 
were 40 points above increases of the 
uncoached grinip over rlic entire r.inge 
0£ the PSAl. 

• Students who were ccacl ed by School A 
prior to the SAT showed a combined net 

ERLC 



increase between 80 and J 16 points above 
a matched ccntrol group. 

• Alliiodgh somewhat helpful, Schi)(U B's 
coaching appeared to be less effeetivc 
than Scho.'l A's for first-time takers. 

• Compared Co rne uncoached group, average 
verbal SAT icores attributed to School 
B's reaching ranged from an increase of 
60 points for low-PSAT students to a loss 
of 33 points for high-P?AT students. 

• Average math SAT scores ranged from an 
increase of eight points for low^PSAT 
student* to an increase of 40 points 

for high-PSAT students above increases re- 
corded by uncoached students. 
Students vho were coached by School B 
prior to the SAT had scores langiru from 
-25 to +100 points compared to the un- 
coached group. [90:62,63] 
Students who took the SAT* twice, yet did 
not receive coaching prior to the exaininat ions, 
showed improved verbal and math scores propor- 
tional to PSAT scores, ivo possible reasons 
were suggested by BRO for the p<ittcrn of improve- 
ment: (i) "persons with higher initial test 
scores tend to continue to develop further than 
those with initially lower rest scores" and 
(2) "persons with higher test scores find the 
SAT somewhat *learnable' even without coaching. 
[90:70] 

Comparisons of students who took the SAT 
twice and who were coached be fovr the first ex- 
amination revealed that School A's coaching was 
effective for all students and that Sciiool B's 
coaching was effective for low-PSAT students, 
but perhaps counterproductive UiV higli-PSAT stu- 
dents. It w<is observed, however, tiiat S^nool 
B*s high-PSAI students regained most of tiieir 
lost ground c^n their second SA I atiiempt. [s>().74] 
Other findings related to tW{'>-time taKers of the 
SA r were : 

• Average ve rb.il SA I score wm reases 1 or 
students from SchcKil A, wtien compared 

4 

\ 
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to scores for a matched control group, 
ranged from 56.7 points to 32.7 points 
from the low- to the high-PSAT scores , 
respectively. [90:74] 

• Average math SAT score increases ranged 
from 57 points for low-PSAT students to 
16 points for high-PSAT students. A com- 
parison of second SAT scores showed an 
average difference of 74 points for low- 
PSAT students, compared tn almost no 
difference at all for high-PSAl students. 
(90:79) 

• Average verbal SAT increases attributable 
to School B*s coaching were 34.4 SAT 
points at the low end of the PSAT scale, 
but showed losses of 55.6 SAT points at 
the highi end of the PSAT scale. On their 
second SAT, School B*s students showed 
losses of 22.8 SAT verbal points at the 
high end of the PSAT scale, compared to 

a matched control group. [90:74] 

• Average math SAT scores showed improve- 
ments ranging from 42 points at the low 
end of the PSAT scale to losses of 54 
points at the high end of the PSAT scale. 
On their second SAT, math scores Increased 
77.6 points from their first SAT math 
score at the ligh end of the PSAT scale, 
compared to an increase of 36.6 SAT math 
points for the control group. [90:79j 

• School B*s initial coaching helped low- 
PSAT students but higher-PSAT students 
made greater improvements than uncoached 
students on their second SAT. [90:79] 

Comparisons of students who took the SAT 
twice and who were coached h^'t^Jf-'en t^xaml nat ions 
revealed that the Kaplan Center's oonrhlng .ms 
,iffective and the Columbia Te.st Preparation In- 
stitute^« coaching provided "minimal benefits": 

• School A*s coichin^ showed Increases 

over the entire PSAT range witl; SAT second 
verbal scores lacrprisinK t rum 3^ to 4i 
polntjs. [90:84) 
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• School A showed second math increases be- 
tween 22 and 76 points from the low to 
the high range of PSAT scores, while tne 
control group showed increases of one to 
35 points. School A's students showed 

a net gain for second SAT math scores 
between 21 and 41 points. [90:89] 

• School B's coaching showed increases of 
1 to 7 verbal points over the entire 
PSAT range. [90:84] 

According to BRO, comparisons of results for 
those students who were coached before the first 
SAT and those who were coached between the first 
and second examinations indicated that coaching 
and SAT experience offered different benefits: 
(1) coaching without prior SAT experience ap- 
peared to ueip low-PSAT students; (2) examina- 
tion experience with or without coaching appeared 
to help high-PSAT students; and (3) coaching af- 
ter an examination appeared to help everyone. 
[90:89] 

The results of BRO's statistical analyses 
indicated that coaching was highly effective 
for the SAT. But the results for the LSAl 
showed only marginal effects due to coaching. 
[90:157] Yet according to Allan Nairn, the SAT 
coaching courses studied raised scores by an 
average of more than 100 points, while one of 
the two LSAT courses studied showed scores im- 
proved by an average of 60 points. [188:102] 

In its summary, BRO stated that standard- 
ized examinations used in admissions decisions 
were susceptible to short-term preparation or 
coaching found in numerous commercial coaching 
enterprises. The analyses indicated that there 
was a "statistically significant diffc ence be- 
tween the score increases obtained by coached 
and uncoacbjd individuals." It was noted that 
the score increases varied somewhat hc^th hj- 
twi'en and within ^he exami nat it^f^ . Ncme the less , 
the BRO stated ^h.it the store increases due lo 
coaching could determine wht. is admitted to 
Undergraduate and graduate institutions. 

/ 
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Siljct the iViihiDjlit of ^ uacii i r^; J. is tli- 
rectly rt'ldted to tfuj ahilitv of individuals l^) 
pay tuition at L'>aLhui>j; sch^o , BRO (oiuiatiuJ 
that "cuachablv s t andar i /cU admission cxannna- 
tU)ns I re.i'-e financial bnrruTs Id uducatKniai 
opportun 1 1 iL's m dirtut Lonfiict" with Lhu ^ah\- 
^russional dec la r.iL i on tli it it is "the pnluv 
of the inited States of Amurita that evc-rv citi- 
zen is tMitilled to ar. educatit;n to meet h's or 
her full potential without finaneiai barriers." 
190:1-2] f arrae t'^ort , BKO said that standarized 
admission exam mat ions d i -,c r iminaf e against any 
individual who eitiier "cannot if ford the uo^t of 
coinniLrriii prej)aration or ele-^ts not to attend 
a commerciril prepar-ition ev-urse even it he can 
afford It becausf- or .\< Dtatue of tht- doi;ma 
promulgated bv the te.^t m.iker^, test administra- 
tors, tind ^f'st Users over Lue past t'vvnty vears 
tliat coaching is valu-'h-ss." I'n):.^] Moreovt-r, 
the exist'^nct' nf a siat'Jo .n.Khii'L; school (SLtu>c>i 
A) that lould actual!", in. ri-as-- an i-Kammtt's 
s< ores on st .i adard i 'ed admisr^ion e ^ami na t Lv)ns , 
BRO >tate<l, mdio^itt'd i •nve rf e. t ions in trio re- 
li.*hilitv and vilidit. i>i test-. -.u( it as tnc SM 
and hSAl . f 90: ] 

Ihe KKO rt«|M)rt r n < ^nncridcd the lollowint; 
arti 'i-ninat^' tht uniair pr.ictnes it 

<!.unieti t> ha^e f uind (I; ^^ub 1 u .it ion ol a le- 
por t t I '1 i^t - . ; < ' ) L -u t 1 It 1 on of 1 or^a 1 i nves- 
tu^^rlon-. 't ! ho 'd'iiatuf.al lostui^; Servito, 
(oll**^',t t '!t r J ♦ X • h » t 1 Ol. Board, and the Amt r- 
ic.m Bar \ ,^.< m ; 1 1 i -ti to ihli'rniino tli<' extent oi 
tlie \ U ' lur. !»'t«"i^ ovor tuen', (1) supi- 1 ♦■mi 
tatjon of t\]t -.tJtisti>a! an il.'si^ m "aa.Utoinpt 
to croa^^' un< ■ > 1. ti jt' 1 1> , !'n)r>' valid ant! r« liable 
adi II ss ion- o ' ( i 1 *- 1 ' I . . " { 4 ) 1 nU 1 at Kui o t 1 a i ^ 
*^at Ion i>; I ; n .t { a i - i' h j n/, s-^ hoo i wh i ( h r i - 
ousi'. vinl itos Noition ■) o\ rin' il( A< t . i'^u.i-')! 

In ^fproml>t r lit;*)'^. -fidv tit Ud • 

r*-'^ • 'r, w 1 > ^ubmi M ot! t ( / t he I . S. lUirc in o* 
ionsumor I'rot ft t i on . \ .nui.tii lUf^r, !ht \U .\v 
( ided to j^.istponc rt>lfi.o ot th.- stud/ in ^Tdcr 



t ' rtariai'. zt' its data. Alter rovieunu itic meth-- 
>JoLoi^\ ef tliL BHii study, tht Hur. . u oj- (.(ai.^umer 
*'r)to^,tioa stated that more soph i s 1 1 cat od aaab- 

^ tnt survey datri were iiecessar" in order 
l<> draw "rea-ionable c uiit-ius ions . " [11^ 2 J \C- 
cordm^^ t^ one education writer, tU^ dela in 
relea.sin;.; the D^'O ntuds fueled sptcaluion tnat 
th^ [ r(. was sitting, on tl'e report bc(.%iuse its 
c<wielusiuns favored tlie ceathing industry. 
llb7:AiOl In January 1979 , Arthur Levme, tne 
attorney in charge of the i'AiO study, resigned 
from the MC because of the commission's "hesi- 
tancy to release the nationwide stud v." Amidst 
the speculation, LIS prcsiclent rurnbul 1 stroi^giy 
dtn^ed that 1 IS had influenced the FTC to delav 
releasing the BRO report, [171:24] 

The Bureau of Consumer Protection's 
Revised Statistical Analyses 
of the BRO Report 

Some six months after the eonclusion of the 
Boston Kegional Officers report, the K'dc ral 
Trade (^JmmIsMon's Burea' of Consumer Protection 
iB( P) complettd its "offieial" revised stit.sti- 
cal analyse^ of the impact of coacninK wn SA 1 
siores. BRo's studv served as I ne bcisi-. of the 
Bl P's reanal V -,e'. , and, like it-, p redi'ce .sor , the 

• . ' :i , > ' 'I .'o . (Marcn lv7',0 em- 

plo\L'd a none^ [U'r iment a 1 design. Howevei, uni ike 
the bPO stud,, lln 15(1''- reanaUsl. -tit<d ! n it 
t tier t ' wa^ "no i ea mi 1 e ^ pec t t ru l o,i. h< d and 
aiu oa< bed gjoup'^ to hive suri,i<ir de'? vripiiU uul 
,ie r-.' 'O i 1 har.e t e r I st 1 1 s . " ( on.,, (, ue nf 1 . , i I 
tco-,( titleTMi'e^ wm un( or.t t o 1 M d ii, tai .ti- 
M.tKal nntivsfs, then iiff-ni.cf . ''otute't 

'^tMi hed and. unvo,uhfd v'roH|i, /M-',nt po t" 

i 1 1 r I hilt ». d <o 1 1' i . to t h 1 i . i H ^ - n , 

ilu' t;('*'s r"ipal%s»- siio-w' d !*i»t I I • pif>- 

.o.i demni'.rapl. I ' pnU^ile- f io ..lofnd oid 
lUK H hed ^t U(h uL s i luj i i it eti i on > i d» t ih U cl i t 1 1 r- 
, e ^ hi t ween the two /,roiips. Ui irl il uer<ent 
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of tne coachtid students ranked in the top iU per- 
cent of their class, compartfd to ^i percent of 
the uncoached students; 41.2 percent of the 
coached students reported family income of *?iO, UOJ 
or more, compared to 17.2 percent oi ^he uncoached 
students; 44.7 perc^Jtit of the coached sti-ient"? at- 
tended private or parochial high schools, onpaicJ 
to 24.6 percent of the uncuached students; 55 3 
percent of the coached studients reported their 
latest grade in English was an "A," compared to 
35.5 percent of the uncoached students; and 48.3 
percent of the coached students reported their 
most recent grade in raatheraatics was an "A," com- 
pared to 29.6 percent of the uncoached students. 
[89:8-101 

Even with these personal and demographic 
differences among coached and uncoached student?, 
the Revised Statistical Analyses found that 
coaching was effective at one of the two SAT- 
coaching schools studied (School A) , and that 
students increased their SAT scores on the aver- 
age of 25 points each on the verbal and mathema- 
tical examinations. Moreover, students who at- 
tended the most effective coaching school appeared 
CO be underach tevers on standardized examinations, 
that is, thev scored lower on these tests than 
would have been expected according to personal 
and demographic characteristics including grades 
In school and class rank. [89:1] 

Table 11 presents data on the overall impact 
of coaching as reported by BCP. Using data for 
firgt-time SAT takers pooled across all the test 
dates (subsample 5), BCP found that coaching at 
School A v^'ovlded an average increase of 29.7 
points to students' verbal SAT scores and 19.2 
points to their math SAT scores. In contrast, 
the results for School B provided -1.8 points 
for the verbal SAT and +5.4 points for the math 
SAT. The study observed that the impact of 
coaching at School A was nearly 30 points on the 
verbal and 20 points on the mathematical section 
compared tt> almost "zero points" at School B. 
[89:211 



In order to analyze the impact of coaching 
upon SAT scores and take into consideration the 
effect "5 of self-selection, BCP conducted a re- 
gression analysit^ to e-^timate the number o test 
points that could be ascribed to the coaming at 
both s'chools. [^J:Z6] As shown m Table 12, the 
first SAT pooled across all the exam dates that 
conside^'ed the self-selection factor indiLated that 
the effects of coaching on both the verbal and 
math SAl exams were considerably less than those 
reported in Table 11. The mean number of points 
attributable to coaching at School A on the ver- 
bal SAT (subsample 5), was 11.3 points co^ipared 
to 29.7 points without the adjustment for self- 
selection, c id the mean number of points on the 
math exam was 5.5 points compared to 19.2 points. 
The results for the second SAT pooled across the 
test dates were different. I'or School A t*ie -i^i"^- 
ber of points ascribed to coaching were lesb tnan 
tiiose reported earlier (16.2 and 16.6 compared to 
27.2 and 28.4 on the verbal and math SAT's, 
respectively). These results were still statis- 
tically significant, according to BCP, that is, 
after the adjustment for self-selection. School 
A had a beneficial influence on both examinations. 
The results for School B were less than those re- 
ported in Table 11, and were not considered 
significant . [89: 30] 

An analysis of the results for each of the 
firs' four subs amp les represent ing the four 
different test dates revealed mixed results for 
Sch)il A. For the verbal SAl exam, coaching had 
a statistically significant effect for only two 
of the four test periods. For the m^ath portion 
of the SAI, School A was ef-ft^ctive only for one 
of the four exams. BC.P stated that "if one be- 
lieves that coaclnng mxi^l he (onsistenlly ei f ac- 
tive bi-fore one can conclud<* that co.iching 
sciioojs Work, one can not st<Ue that (<.>aching at 
School A Works (at least .ifier tctkir*.*; iiit.^ account 
self-selection) ." [^^ 30-31] Both h. f<^r^' and 
.ifter taKinsj; tlie effects nf se 1 f -so t i (>n into 
at t (Tunt , the resu 1 1 s i rui ic.it ed that l OAch i ng .it 



ERIC 



62 



TABLE 11. — Overall Impact of Coaching: Mean Number of Points 
(and Confidtincfc Interval) Contributed t)y Coaching School 



School A_ School B 



Stanley H. Kaplan y_y5j*tU) n __Ce_n t e_r l^yJr ^par ation Center 





Sub sample* 


Verba] 


SA r 


Math 


SAT 


Verbal C^aT 


Math SAI 


1 


I,!*- C4r /■/7c: 

ist oAl 4//^ 


18 


34) 


1 7 


. 1 




■kifk 






(^ - 


(0 - 


34) 






2. 


1st SAI 4/76 


44. 


5 


26 


. 3 


3.5 






(n = 658) 


(33 - 


57) 


(14 - 


39) 


(-10 to 17) 


(-13 to 15) 


3. 


2nd SAT 11/75 


26. 


9 


22 


.4 


0.5 


27.9 




(n = 359) 


(11 - 


4 3) 


( 5 - 


40) 


(-25 to 26) 


(0-56) 


4. 


2nd SAT 11/76 


25. 


4 


30 


7 


9.5 


2.0 




(n - 438) 


(14 - 


36) 


(19 - 


42) 


(-11 to 30) 


(-20 to 24) 


5. 


1st SAT - Pooled 
















Time Periods 


29. 


7 


19 


) 


-1.8 


5.4 




(n - 1578) 


(21 - 


39) 


(10 - 


^0) 


(-13 to 10) 


(- 6 to 17) 


6. 


2nd SAI - Pooled 
















Time Periods 


27. 


2 


28 


4 


5 .5 


3.0 




(n - 1176) 


(19 - 


33) 


(20 - 


37) 


(- 9 to 20) 


(-12 to 18) 



* 

The sample sizes reported here vary from those reported in the methodology section of the 
text because some students did not respond to one or more items on the Student Demographic Ques- 
tionnaire nnd were therefore dropped from this analysis. 

** 

Confidence intervals. 

*** 

No one taking this SAT exam received coaching at School B. 

SOC'RCE] Federal Trade Commission. Bff^^ot.) of Coackirvj on Standardiz^'d AJjvi.::: ion Ex'mir^itzoK.: : 
roic.^' I .'tati.itical Analuiu-,^ of Data Gathered oj Boh ton Rt<rlonczl Office of tho F-: L r>j,l 
Tt'zJ^ CoP7n''\\) ioYi. Washington^ D.C.: FTC Bureau of Consumer Protection, March 1979» 
p. 20. 



School B did not have a statistically significant 
effect. (89:3i] 

While BCP founff some evidence that students 
wht) were not underac h ievers on standardized tests 
(Ou!d benefit from roach ing at J>chool A, tliese 
results wer»' nt.t conclusive since data were 
available (^nlv for one test. [89:ii] Overall » 
tfie B(T study pointed out that before concludm^^ 
that School A was effective and School B was not, 
additional an.ilyses wt^tiUi have to he tondutted. 
V\\v BCP felt th.it It was plausible that self- 
selection Itself was responsible for the effec- 



tiveness of coaching rather than the coaching 
per se. [89:22-23] Nonetheless, BCP stated In 
its Fr 'ir.cd ."Jtatistlt'cl Analyocr. that "Even 
though is can't be firmly concluded that q< ich- 
ing will work for everyone, the results of the 
study do show that coaching can be effective 
for tfiose who do not score well on standardi/.ed 
tests." BCP cautioned, however, that "If large 
numbers of stcdents were to obtain coaching be- 
cause they felt it was effective, the/ miglit be 
very d 1 sappo Inted if In fact coaih Ing real 1 v is 
onlv effective tor tinder a ch i ever s . " [89:35] 
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I \hf K I i . ---I mpac t .jf (o.icnin^ Xdjusim^ r^r Scl t -^t 1 t-v. n on : 
Mean NdTTibrr of Poiiitb (and Con M di-'U-L-- Irittrvil; 
{.i>ntribtiLt'd by (.o.iciMUfi SLnLJol 



School \ ''iJ'^V^l 

:> -> L ''I e tcir.it lun tLMitt-T 



S u b ri in[)^l e \ crha l SAl 



S t a n I L* V Ka p i a n J^.d ul a t n ( n f e r 



(n ^ -W6; to ^0) ' {-Z7 

2. Ut SAI '-.//o ib.b 7.) c.^^ 

fn = hjH) - U:)) (-11 to Ih) to JJ; (- i J t ' iUj 

3. 2iid SAl 11/73 :i .'-i 6.7 8. J 3-M 

(ti - 339) (i ~ 3j) (-2U to 3-^) (~3b to .)J> (-il to 7j) 

4. Ji<iSAI il/7b i;;.3 -1.3 j..^ 

^ ^ - ^4}8) no j>(tj (0 - 39) (-38 to 33) (-34 tc> 41) 

:> . 1st SAl - Pooled 

f i mt- r i od ^ 11.5 3.3 - i . J 13.4 

(n - i3/H) tu J3) (-8 to l^O (-^0 to 13) ^-4 'A) 

6. 2nd SAl - PooLrd 

Iim*- FVriod^ lb. 2 lb .6 -J. 9 — 

(n = M7b) (2 - 31) (2 - 31) (-29 to 21) (-29 to 21) 



( on fi deuce intervals. 
**No ont» takiiii', tins SAl L'xam r«.^ceived coaohing at Scliool B . 

SOI'KCF:: Federal Tradt- ("ommi sbi on . -/J'-''" '2* 'O'lr^h'.ng on ' tayt iivdi d 'l'r:r,r')y. h^Xtir/yuit ' . . 

"rii 'nr''.-r' jk. Washington, FTC Bureau of Consumer Protection, March 1979, 

p. 29. 



Criticisms of the BRO Report 

!'i '^av I i/M, th« pr( 1.^ ^i,. ini- 

tial Boston Kt'^^.ional ^Mtico ^tudy and thr- "ofri- 
clal" Bureau ot Consumt-r Protection sfuiv. 
like B(.n'-, studv, the BRO '^tudv stated that 
coa(hin>; was ♦■ftective for the SAT rn<\ fojiid in 
the dr' rmlnin?, t<ictor in deciding whn is a^iuutf^d 
ti^ LolleK*'. The BRO stud.' also stated that f oa<M> - 
able standar<! i /A'd idmlssion examinations freat^n' 
finanef.il b.irrier^ to thosr pursuing, ediKafiontil 
opportunities and tiiat , ti.er»^toir, the tests w^-re 
In direct <.c»n*^iict with the nation's (mIuc at lorj 



ptU icv. The bHO study further recommended an 
investigation ot the College Board, tihe Kduca- 
t iojial Tes t ing Service , and ' the Ame r 1 can Bar 
A.^soc lation. (90:1-3; 114:1J While the BRO 
studv found that students ( ould improve their 
combined test scores bv 100 points, the BCP' . 
revised statist k a i analyses found that stcdent^ 
<.ould improve their test ^^^ores hy 23 [)Oi?Us 
ea<. h on the verbal and ma themat » " a 1 ^tition^ 't 
tht SAl. 1188:102, 89:j ] 

B( P att.iched a one p-iy,c dls^ l.il,ier t»' t !u 
BKe studv, ex{H lining what it termed -^tTo "'Ua j »r 
ilaws m th*' oata an^ilwis" whn h '~ ie the te- 
'aiit » unreluhle. Albert Kramer, iUrnti-r id 
B< P, ^lid t ri.U "we rej.: ird the • t uf*\ a. hein., -'t 
lirrated siyjiifit uu e . " Ar.i n>; the Maws < it^a h 
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BCP were the following: (1) the BRO studv failed 
Lo control for differL'nce| which existed in per- 
sonal and demographic c!idn:ac tei 1 st ics of coached 
tnd uncoached students'"* (Z) without controlling 
for grades, it was not possible to know if SAP 
score differences between two groups were due to 
coaching or differences in skill represented by 
past school performance; (3) the report did not 
provide tests of statistical significance neces- 
sary to Interpret the results; (4) findings 
were given for students who had a gifade point 
average of 1,0 (a D average), and because there 
were no such students in the sample, It was not 
justifiable to predict the action of that group 
of students; and (5) the study^s conclusions 
were limited due to the lack of controlled ex- 
perimental conditions, [90] In releasing both 
studies Kramer said that the FTC wanted to sti- 
mulate further research and public discussion 
on t\' usefulness of coaching, but it was up 
to parents and students to determine whether 
commercial coaching is worth t^e expenditure 
of several hundred dollars, [95:3; 167:A10] 
In response to BCP's disclaimer, Arthur 
Levlne, former BRO staff attorney in charge of 
the Initial investigation of coaching schools, 
said it was disturbing that after three and a 
half years and $300,000 th- FTC had decided net 
to remedy a "glaring inequity in our national 
education svstem," [165:1] "I see this as an 
abrogation of th«iir responsibility to consumers," 
he said, [l67;AiO] In a similar vein, Terry 
Herndon, executive director of the NEA, denounced 
the ^TC for an Incomplete job of Investigating 
private coaching schools, Herndon said that it 
se<»med the rrc was '^aligned** with KTS and CKEB 
and, therefore, was unable to conduct an imp.ir- 
tlal Investlgat hni. [I95:2| "People who can af- 
tord the . t)sr of hoathingj schools," Herndon 
slid, "thus fiave an unfair advantage at Important 
rr.insltion points." (IftB.fll] Aciording to ttst- 
i ng critic Steve Solomon, the HKo study posed .i 
political dilcmm.1 for the KTC . Solomon rep(>il"<i 



that an internal May 15, 1979, memo from Albert 
ivrarnt-r to MC Commissioner Michael P*^rtschuk 
stated that: "The greatest consumer injury suf- 
fered by an applicant taking a standardized test 
comes not at the top or m the middle range, but 
as the student ^s score approaches whatever arbi- 
trary cut-off the college or university imposes 
. . , .If the school's cut-off is 300, the dif- 
terenee :;etveen 520 and 495 is critical. Hiere- 
fore, perhaps even the small coaching-attributed 
score gains acknowledged by ETS/CEEB portend some 
degree of unfairness to test-takers and would 
render deceptive their admonition not to be 
coached," According to Solomon, the FTC decided 
not to bring a deceptive trade practice suit 
against £TS because of its limited resources, 
political criticism of the scope of its activi- 
ties, and the uncertainty of whether a nonprofit 
corporation fell under the FTC's jurisdiction, 
[260:4] 

ETS, on the other hand, criticizet' the BRO 
report, stating that previous studies by ETS and 
others over a spa., of 26 years did not reach con- 
clusions that would support the size of BRO's 
findings. Among the criticisms leveled b> ETS 
against the BRO study were the following: (1) 
poorly designed research and erroneous conclu- 
sions could adversely affect students; (2) an 
apparent endorsement of coaching may- encourage 
students to look ^or short cuts in preparing 
for standardized examinations; (3) students may 
be victimized by commercial coaching schools 
which make unsubstantiated claims and charge 
exorbitant fees; and (4) the studies did nut 
take into account the provisions that KiS has 
,llr^M^{v m. li' regarding the p re pa rat it^n stu- 
dents, irtv-ltidlng distribution of a -sample tc^l 
.md d 1 -.(_ u^s I on qiies 1 1 oris to test take r . Other 
t riti« Isms ot the BRO study incliuleti tlie la^ k 
of L^TiLr^'l for student molivatu^o, cHsrei^ard tm 
i;ener U intelhutual dt ve loj^munt t>ver timr, and 
the terror present in all tvpi's .>f ilk a ,ur erne nt » 
f IS further nraed lh<it tJie BIJO study t'iUind ao 
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reliable re->altb (onLerning tht- 1 S.M . [ 7-+: 1-3 J 
Former Collect* Board Prt'oidcnt Robert J. Kin^^ston 
said that the FTC repoiu-» could not "stand ag.iin*5t 
the wealth .fff carefully directed research in this 
area,*' that shows the iM is "iiigbi> resistant to 
coaching." Kingston further said chac some in- 
dividuals cv -id A'Un from focusing their intel- 
lectual and emotional energies, but researchers 
still needed to know a lot more about the partic- 
ular characteristics of students who enroll in 
coaching schools, as well as the aspects of 
coaching programs thit seem beneficial to 
students. 1113:2) 

ETS's Reanaiysis of SAT Data in the 
1979 Federal Trade Commission Report 

In May 1980, FTS held a press briefing in 
Washington, D.C. and presented a summary of its 
reanaiysis of the FTC study conducted in 1979 by 
the Bureau of Consumer Protection. In **The Ef- 
fectiveness of Coaching *^or the SAP: Review and 
Reanaiysis of Research from the Fifties to the 
FTC," ETS stated that without random assignment 
of students, such as in the FTC study, one could 
not expect the effects of special preparation to 
be separate from ,i student's personal or back- 
ground characteristics. Random assignment as- 
sures that there is "no systematic difference 
between the two groups," if proper controls exist, 
except that one ^.roup receives coaching and the 
other does not. Since the FTC study lacked ran- 
dnmizat K>n, there was no way to interpjer the 
findings. [177:M Sucn f ictc^rs responsible for 
students seeking ro.ictung may include lower than 
expected PSAl' and SAT scores, in light of pre- 
vi(^us grad or an attempt the student tu 
a<-f|ulre high test s<ores to make up for a "pro- 
sal< high school p< r f orniatu e . " Fi'S's reanaiy- 
sis obSfTVed ihlt "ti)e ''ffects ni se I f --.e 1 et t i m\ 
are confounded with effe(ts .>f lh<' co.uhing 
treatment in nonraud'^ml /e(i studjc- aivl, 

o 



f.on-.e']uent I V , -.elf-selet t ion t<ut';rs afl«?rd 
p lausi b] e r 1 yal ex[)l<ina t luas [ u r tlie re -.u 1 1 . 
or tor p.ift ol the results, that mi^ht t-^thu- rwi->e 
he identitied as co.ichmg effects," 1177:^J 

HS further stattd that an historidl over- 
view of the effects <;f cojching on the SAI prior 
to the ITC s tudy showed that some st udies at i- 
lized nonrandomized designs or had poor controls 
or small samples. [177; 2 J But the average ef- 
fect of coaching in these earlier studies with 
control groups found score increases of less 
than 10 points for the SAT-V and less than 15 
points for Che SAl-M. Lib cited the Evans ancl 
Pike study (197 3) which showed a 16 point in- 
crease on the SAF-M for students who were coadied 
over seven three-hour sessions and who were as- 
signed 21 hours of homework. For the SAl-\ , LTS 
cited the Alderman and Powers study (1979} wnich 
found an eight point increase on the SAT-V for 
students receiving special preparation at eight 
sec^ondary s hools. ETS noted that "stadit^- Lack- 
ing 'ontrol groups produced larger score effects 
but since they differed from control-group stud- 
ies not only in design characteristics but in 
critical [jrogram characteristics, t.ieir interpre- 
tation was especially problematic," [177:3J 

FTS included two specific reanalyses of the 
FTC study. The first covered three commercial 
coaching schools, including one which the FTC did 
not analyze because of its small sample of st^- 
(ients. The overall results, however, were com- 
parable to the FTC's findings, saying that "in- 
consistent and negli:uble effects for students 
at two schools and for students at tht tfiird 
school combined co<irhing and se J f -se L'C t kui et- 
lects ot about ZO ti> 3? pt>int^ tor hotn VY'rhai 
<ind Math scores." 1177:^-')] Moreover, MS 
fv>untl tnat a small s.implr of li hla'k -^i'uu.\l^ 
attending one of the to u tuny, sfhonls th.il 
sh.'wed ii* ^il 1 il-j I e { n t , Mver 1 1 1 r mm :> i w d 
lar,N*r < oat h i n^'/s(>l f Um t i on . m i t'lto t 
h.uk'. nr. tlie SAI-,, 'tit nt^t tht \'i 
stu.!.'nt > rr{M>rtirn', l(w t -inn T n.< o-^v.a 
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great'.' r i o.u h IH^/sl*! r -^fleCL l"h cMt.nLs LU II. 

thosf report ini; l.imilv itin>nt*. il/7:S] 

hIS's s'.-i^ond fL-aua 1 v -> I o iOi)k inLo ai.vount 
the growth rate m b.M sc on*.^ ovfr tink*, ^ujt 
did n.)t idiu-»t for ->t' 1 f-->e I er t i on factor-, i>r 
otiiL-r factors ciot reiati'd to diHcretitial 
growth. 1177: 5 J Ilus rt-ana Ly->i -> was pcru.r-ned 
on d.ita from the lan^est toachin^ s<hooI whi-ch, 
according to tlie '"i^ , also reportt^^d a r«.*]rituin- 
-»hip between coaching school attcndan-^t- and bAi 
pt*r furmance . Actording to lilS, .ifter tikm^ 
into account the differential growth, com- 
bined coach I ng/sel f-^e lec t ii.>n effect >ieLded 
about 11 p(.)irits tor the SA[-V and JM poi[it^ tor 
the SAf-M. [177:6] 

Overall, the summary of l i S * -> re<nidly^is of 
the KTC data revealed "cotisiderah It* variability 
in the coa*. ti ing/sel f ~se lei 1 1 o[i cfleLt-^ a.ssoc lated 
with « oactli n]^-sc hool attendaiue, with negligible 
effects at two st^hools .iinl an estimated lombmed 
effect for .student-, at one .->chooi of about JO tt) 
'^0 poiiitb on SAT-Math and very likely .ihout half 
that (as reflected in corretti^p^ for differen- 
tial j^roup growth rat on SAI-Xei'hal. [177:6] 

The his su:nmary emphasized that **in any 
evetit, whether due to t (^aching or to personal and 
backgrouiid far tvir->, :r>core mcreases of JO to ]U 
points on vi li'ii- to Hoi) point si ale C'^r respond 
to approximately three additional items < orre< t , 
and thf' ^^atiif etf»'i t mi^ht ^e ofjtainod if students 
V. 're to devote fom[»irabIe Lime and effort to in- 
dependent ->tudv *>r regular irademu courses." 
I 177* 7 I hiS rurther nni.<f/d that no ->tud/ h.is \fi 
addressed ihf f^u'^-vtioi^ vJh 'tor .••»ri. ' r» )m 
ref!(Mt sra! Ii*, lonu-ttr'n iniproveinents in i stu- 
dent*^ verbal k^r nia t h r-mat i ( a I roa->oning -1- i 11 ^ 
(^r i!icrease*< 1'^ t»'sr wi st-nrs-, or wii.it hind "f in- 
strut titm mav be mo->t benetnial tor dnter»-nt 
kinds of -jtudents over i (♦tt-un period oj time. 
|l7/;Hj rht' LIS .nmmir'v r^f omnionded that te-.t 
fak»^rs -.houlil pro^.td»Hl with test tamiliarizi- 
rion materials ind .tiu't iid-^ usehjl to tt'^t 
ttkln^, prepares} uid di-.tributed by the (.oll.^.e 

o 
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boari. "Is~uts or o'fui cy i>T at t cs-. 1" ioavriuv.^ 
pro Tan, that iu'i,'> viver one sui h o..t ran-'-'U^ I ,1 
'J i r f i i_ u 1 t> , " tht suriniar> conclndfU, "b^*, opk l: - 
,^'Ttint to the- eAtefit tlnit studeiiL dilforta^cs 
in t(. ->t -tak MU' skills per so ^ ih s t .u\C i -i 1 1 . i n- 
f lut^ nc.e te ^t -a i^ro - . " 1177 } \ 

L'S is p'lannin^, to /ublisi' 1 1 ^or-Dlete ro- 
anal, is of ttio I t( dat.i sliortlr. [IJJ'Ii 

NEA's Analysis of SAT Data in the 
1979 Federal Trade Commission Report 

A I'j1> l^Hh pubiif iti-^v, " ' : - 

' z";;; " T '* ' ^ repc>rted t-K find- 

ings of the National Iducati on \c>soc ia 1 1 oi^ ' s own 
inai\sis of the »^1C data for students v;no had 
taken the PSAT 0[ice and the SAI twite. I sing 
the r T C dvxv3 base, the c o a c 1 1 e d students in the 
sample were selected from tne coaching s( hool 
previously identified by tiie ITC as having 
"produced tlie r r c results." - 
"riiM: i\ ) riie sampK of 1,32-4 students included 
hib who Were administered tiie tests i n 1973 , tind 
^99 students wh{) were ^^dml n i s te red the tests in 
1976. Students werv assigned into groups b ini'd 
on wh5.'Lher the^ nad been coached arid when the> 
Were coached. In 19 7:>, 65 students were coached 
between thie PSA i <ind their first SAT; 103 stu- 
d<^nts wer^' ' oat lied Ik LWeen their tirst and second 
S\i; and 405 students were uncoarn<d. In 1976, 
IIM students were cc)ai.h* d botWe<n tho I^SM and 
their r i r-^ t SA f ; i 7 i t udont '^o re > oacht d be - 
tw^.«''i tbt 1 r first .ind -^fc tuul SAI; and +08 stu- 
(k'nt we: t unrom hod , 1 at n student w.is used 
1'-. ill , ^r tu r owe < (Mitrol and no ( ump.ir i -.on 
Wert M«adt inHuig the >:roups . Un mt .isnre ot 
i\t owt h omp 1 o , t' J in tilt L ud was tho a v\ ra 

I i\i r f I ^o ht two* n t lu \ ! Hid tho ^ff oiui \ I . 

Xi'wrdm/, t(i MA, tm-rf v. r< .iKuifn nU 

I I t ' e ro lii e •> foi oa( .i o! tiie th^**- s». ,J ou^l*^ in 

.tnd 1M76 ht-twt ( n f ao >'s,\I K>d ^( ^ ond S\I 

« 4 
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scores, (See Table 13.) This analysis of 1975 
data for the group coached between the PSAf and 
the first SAT demonstrated an average increase 
of 114 points, while the group coached between 
the first and second administration of the SAT 
djmonst rated an average Increase of 104 points. 
IiW:ontrast, the uncoached group experienced an 
average gain 44 points*. An analysis of 1976 
data for the groi.p coached between the PSAf and 
the first SAT demonstrated an average increase 
of 143 points, the greatest aveiage score gain 
reported in any coaching study. The group 
coached between tlie first and second SAT demon- 
strated an average increase of 133 points. Tne 
uncoached group experienced a gain of 60 points. 
[194:25) 

NKA observed that co iched students rould 
Increase theii combined verbal and raatr^ SAT 
scores the second time they took the test more 
than uncoached students, [199:5] The analysis 
also noted that there appeared to be a relation- 
ship between average family income and coaching. 
[194:25] "Common sense would suggest that if 
one Is taught four hours a weeK for ten weeks," 
the report emphasized, "there shoui ^ be on the 
average some positive results," [194:26] The 
analysis further stated that NEA believed that 
differences of 23 or 50 points on the College 
Board's scale of 200-to-800 could make the dif- 
ference in determining whether a student is ad- 
mitted to the college of his or her choice. 
Since many families cannot afford to send their 
children to expensive coaching schools, the NEA 
called for all students to be coached free of 
charge. [194:26] 

Slack and Porter's Criticisms of ETS 

Warner V, Slark and fk»iiglas l*t)rLer, of the 
Harvard Medical School, contended that the Issue 
of special preparation Is Important because if 
students can raise their test scons fw stiulvin^ 

ERIC 



for the SA't, i\ the tests do not comply with 
R>dns and Frederiksen's 1951 definition of an 
aptitude test as "a device for measuring the 
capacity or potentiality of an individual for ' 
a particular kind of behavior." [258:155] 
Slack and "Porter critically reviewed 29 studies 
on the effects uf coaching. All of the studies 
were published prior to the release of the Col- 
lege Board's 1968 booklet Effects of Coacninj 
on J c^r tolas tic Aptitude Te^t Score a , in which 
the College Board statec" that "the evidence 
collected leads us to conclude that intensive 
drill for the SAT, either on its verbal or its 
mathematical part, is at best likely to yield 
insignificant increases in scores." [258:136, 
161] 

The authors noted l lat the College Board 
and ETS made repeated references to seven stud- 
ies (Dear, 58; Dyer, 1953; Frankei, 1960; 
French, 1955; French and Dear, 1959; Lass, n,d.; 
and Whitla, 1962) ?s the basis for their state- 
ment that special preparation is ineffective, 
[258:156] According lo Slack and Porter, how- 
ever, the best methods of special preparation 
were not employed in these studies, (258: 1d8] 
They further charged ETS with failing to refer 
to other studies in the literature which show 
that coaching can be effective. They claim 
that ETS made no reference In its 1968 publica- 
tion for students to two important s tudies , 
published in 1961 and 1965, which indicate that 
special reparation car improve students ' 
scores under certain conditions, although Mar- 
ron*s 1965 study was, in part, supported by a 
grant from the College Board, [258:159; 202:1] 

In particular, they charged KTS with ignor- 
ing a 1961 study by NathanUl Pal lone, a guid- 
ance counselor in a private college preparatory 
boys school. After analyzing SAT-V items sup- 
; J led bv KfS, Pal lone designed both short-term 
.ind long- terra courses to improve his student;?' 
test scort-s. The short-term prt'parat ion included 
.1 9l)-mlnute daily training in verbal analogie.s. 
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(ABLh I'K — to let t Xverage SA i ^\;int <..iin SloTc*^ fur ( oa( hed .ind 
N.)tK.< 1^ jkmI i'^M and iwo-iimi- SA'l lak^T-* tor JV75 and 19 76 



TotTl " ' * VcrbiT Math Average 

Average Average Average famiiv 

Year P oint C ain .„Py.>^lt ^j-^J^n _ ^<^A"^ Clam ^-i- EL^^^l^ 

1976 Coached between 

PSAT and 1st SAF 14 3 73 70 s 29,000 
1976 Coached between 

1st SAT and 2nd SAT 13d 65 70 26,000 

1976 NonLoached 60 29 31 21,000 
1975 ' Coached between 

PSAI and 1st SAT 114 55 59 30.000 
19 75 Coached between 

Ut SAT and 2nd SAT 104 47 57 26,000 

19 75 Noncoached 44 17 , 27 20,000 

SOURCE: National Education Association. Mcasur^iment and Testing: An NE^ Perspective , 

Washington, DC: NEA, 1980, p. 25, Copyright 1980 by the National Education 
Association, Used with permission. 



vocabulary, and reading skills over a six-week 
period. The mean gain of the 20 seniors enrolled 
in the program was 98 SAT-V points. The long- 
term preparation included a 50-minute daily 
training from September to March; the mean gain 
for the 80 students was 109 SAT-V points. Accord 
ing to Slack and Porter, the 20 seniors in the 
Hhort-term couv^e experienced a gain of 84,7 SAT-V 
points above the 13.7 point increase normally at- 
tributed to practice and growth between tests over 
a five-month period; the 80 student enrolled in 
the long-terra course experienced a gain of 79,1 
points above the 29.9 point Increase expected 
over a 12 -month period between tests, [258:158- 
'*'^159] Additionally, Slack and Porter claimed 
that ETS failed to reference several studies by 
Marron in 1965. Hiese studies (if high school 
graduates m a private prep«i ratt>rv scho(»l showed 
that students »nt reaped their SAT-V score bv an 
average n\ "iB poltits and their SAT-M sc^ore bv an 

See ilso, "Frrata, -J ivv<ird c.dU'\i* ^^r^i' 
..."*rt.% 50 (August 1980), p. 45 7 . 
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average of 79 points. These gains were 41,1 
points above the gains in verbal scores and 
67,6 points above the gains in math scores at- 
tributed to practice and growth over the six 
months between testt>, [258:159] 

Table 14 shows the results of 29 coaching 
studies completed prior to 1968, The authors 
reported that the weighted mean gains of the 
studies cited by ETS are 16 points for the 
SAT-V over a control group, compared to 40 
points in studies not cited by ETS, The 
weighted mean gains of .^11 studies was 29 SAT-V 
points. Similarly, the studies cited by ETS 
showed an increase of 12 points for the SAl-M 
over a control j^roup, compared to 55 points in 
studies not ci t by ETS, The weighted mean 
>sains of all stuau-t. was 33 SaT-M points, 
i 258:161 1 

Slack and Porter stated that the College 
Board and 1 LS point out Lhit score increases 
attributable to <().u'hirm are less than tne 
st<uK{,ird err(»r <^f measurenu^nt , yvl thi^\ <io not 
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^AU studies listed In Table 1 were puhllrihed prlur to the 1968 publication, Efff^ctv of ^wicrin^ ,m .onoliC'ti^^ ,;r::tto^^ TucT* 
'.'<X>r' (CELB, 1968). '>tudu- In LmU ' i t were either done hy FTS or sponsored b'V them or the College Board, Asterisked studies 
are those not cited bv KTS and the College Board when theV feeched their conclusion , .slovly and with care. • " that coach- 
ing . is at best llkel/ to yield Insignificant Increases In scores" (CEEB, 1968, p. 8). 

*'Sonie studies reported In the bame publication have been treated Independently. Pallone's short-term and long-term studies 
(1961) used dlff.-rent students at different times of the year, Marron*s study (1965) was carried out In 10 separate schools, all 
with different prograM and students. Marron grouped the schools statistically according to differences In Inltld and final 
test scores, we have treated each group as an Independent study. In Dyer's study (1953), seniors taking math and not taking niath 
performed differently, and we treat them Independently. French (1955) used two experimental srhoola with different programs, 
**SA1 Coached" and "Vocabulary Coached." which are treated Independently. Students taking senior math and not taking se. lor math 
did not differ Ih performance In either the French (1955) or Deat (1958) studies and are not treated independently in the table, 
RobertS'and Oppenhelm (1966) reported on rural and urban students who did not differ in per forma, u t' Coffman and Parry ( 1967) 
reported on three groups. We have omitted (.roup C because the class period "was not long enough to permit the adnil nl';t fat ion of 
the total verbal test" (p. 293), the Incomplete scores were er^uated to the College Board scale using a different group of stu- 
dents, aid a mean decrease of 28.9 points suggested problem.s with student motivation, (rroups A and B were combined because there 
was no difference In their perfc .oanv.e . 

^■For St idles without control groups (P-jllone, 1961; Marron. 1965; and Coffman & Parry. 1967), rhc reported gilns in scores 
have been reduced by the Increase I ^ «cores to be expected fron, racflce and growth. This expected Increase, which .'.iries with 
the »tore obtained, was calculated Individually for each study (see h>otnotp jl). Thus, the scores shown are estlm^ites of the 
gains In points that could be expected over a contrf)l group with equlvalfnt Initial s^^ores on the SAT. 

'^See Fi^otnute 9^ 

^In French**^ 'n-li{lnal artl- le (1955) the follfrwinx n's are xlven jAT Coached - 188, Vocabulary Coached « \ Zh Wc have 
iisqd the values from French and Dear (1939) because they t,ppeared in a rcfereed journal after French's original publi<atiun. 

'^SAP C oat hed A is a i omp.ir I -.»ni betw»'en the *^\T Cuai bed f.rou^i and the (ontrol (,roup, SAT Coaclitd B ( omparu-, tht' SAI lo.iched 
and Votabul*ry Coached roups. 

See Footnote 3 

*^See "Errata." /ir''/r'f -i'A'^r r^K.T. 30 (August 19H0), p ^37 

^footnotes refer t^ notes in Slack and Porter's .original irticU'. 



>i>l R( F Warner sia(k ind OntiKlas Pi.rter "li>** ^-tioJastlc Aptltudt* Test. A Critical \[>p>ah.al," iirrwl - ^ 
30 (May 19R{)) , p }t)l Copyrl^^ht l')HO bv the Viv^i lent and M'llnws of Harvard <<^llo^;r i'se<l with permisii,n 
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discourage collejje admissions committees from 
making admissions decisions based on Lest scores 
that are less than the standard error. [258:16^] 
Moreover, they reported that ETS studies at 
eight coeducational colleges in 1962, 1964, and 
1965-67 conducted by Schrader and Stewart (1971) 
found tha't the difference between the scores of 
all applicants and those admitted to college was 
24 points on the SAT-M and 27 points on the SAT-V, 
much less than the score gains reported In several 
coaching studies. (258:160j Overall, Slack and 
Porter said that they found nine conclusions in 
publications sponsored by ETS or the CEEB and 
seven assertions that test score gains attribut- 
able to coaching were not significant, although 
there was ample evlde^nce to the contrary. [258: 
163J They concluded that students can success- 
fully prepare for the SAT, and the more time 
students devote to special preparation, the 
greater their score increases will be. [258:164] 
"Common sense as well as experimental evidence," 
Slack and Porter .aid, '*belles the contention that 
students cannot effectively study for the SAT." 
[258:163) Slack and Porter called upon colle^ses 
to drop the SAT requirement from their applica- 
tion procedures as Bowdoin College a^d the Uni- 
versity of Wisconsin hav^done. [286-A21 

In response to the^lack and Porter article, 
George Hanford of tht/co liege Board stated that 
the authtus took a partisan view rather than a 
scholarly approach to their critical review, 
since they had previously a^sistc^ Ralph Nader 
in preparing the report, Thr Hi-jign of ETll. Han- 
ford noted that the two studies proninently fea- 
tured in the critical review, Pallone (1961) .md 
Marron (1965), *' Involved special preparation 
over flir rrf-t^r ' irt i^f i v^.^r." [emphasis in 
the original) ConsecjiK'nt 1 v , these studies were 
ru"ft short-term drills on test questions, hut 
rather "studies of Ihv effects ot extended edu- 
cational programs focused on tl^e SAF." H<infurd 
further not eel that both studios were flawed and 
categorically rejected Slack and Porter *s 
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assertion that the College Board and ETS has 
suppressed studies that sliowed coaching to be 
* effective. Hanford stated that bota studies 
were described in an ETS reg^arch bulletin on 
short-term instruction for th^ SAT (January 
1978). This bulletTn was also distributed 
later as a College Board research and develop- 
ment report.^ [122:1-2] 

Alice J. Irby, a Washington-based ETS vice- 
president, further stated that several of the 
studies cited by Slack and Porter lacked control 
groups and "were defective from a design stand- 
point." Irby explained that the 19b5 studies 
were actually equivalent to "a fifth year of 
prep school." She added, "That's learning, not 
coaching, but the authors have not made that 
distinction. To the extdnt that people take 
more courses and put in mi^ich more study, then 
they should do better on ::he test and should 
probably do better in college." She criticized * 
Slack and Porter for their implication that stu- 
dents who attep'^ a coaching school will automa- 
tically experience large gains in their test 
scores. [100:5J 

In an August 1980 article in the Harvard 
Educational F^^'-^'Ijw^ Rex Jackson of ETS responded 
to Slack and Porter's "critical appraisal" of 
the SAT. Jackson noted with regret that the 
Harvard Eduijational Ftwuvo) had been employed 
"to present a seriously distorted and inaccurate 
brief on one side of an important public issue." 
'ickson accused Slack and Porter of using selec- 
tive pfirtions of published information concern- 
ing the SAT to fit their case, out-of -context 
({uotations, half -truths and misinf opmat ion , and 
of failing to provide a fair presentation of 
Che (.oUego Board's statements which describe 
the SAT a.^ a measure of developed .icidemu 
abilities, r<ither than as "a 'Measure ol fixed 
capacities." [ 1 J4 . 1 : 38 J- 3BJ ) '> ick.-^on strtst,ed 
that all of the studies listed hv SlacK and 
Porter l:ave been previous Iv i led in RiS re- 
ports, in reviews of both tt>aching and 



C - 



71 



instructional [>r<)>5rar"s of l(;iv^er duraLiun (IMkt, 
1978). in4.j:384] But he noted that pro^ranus 
ofLerin>4 substantial instructiuii over an extuiideJ 
ptrlod of timt "hive K^nerallv not bt»en discusSL'd 
in publieations conctirn*^d exclusively With short- 
term coai.nin^/' IIJ4.1:J84) Nat only did Slack 
and Porter lump to^ethur short- tern coaching pro- 
s?rarai> and longer-tfrm educational programs, lack- 
son said, they increased "the effects shown lu 
their table by inrLuding the results of a special 
study usin,4 a posctest nuide up of items identical 
to practice exercises on which students bad beeii 
coached (French ^ Dear, 1939)." [134.1:385] 
Jackson further stated that Slack and Porter 
devoted too mucn space to studies Chat were from 
13 to 2/ years old, while ignoring more recent 
studies by Pike and Kvans (1972), Alderman and 
Powers (1979), and ' Federal Trade Commission, 
Bureau of Consum . Protection (1979), which are 
essential to a comprehensive review of coaching 
research. ltJ4.1:38S) Jackson characterized 
Slack and Porter*s "critical appraisr.l" of the 
SAT as unfair, inaccurate, and ir respons Uj le . 
He emphasized that "decades of practical experi- 
ence in the use of SAT scores, has persuaded. , , 
educators that the test scores are useful for 
their Intended purpose — to supplement the sec- 
ondary school record and other information about 
applicants in assessing competence for academic 
^ work in college." [134.1:390] 

Following 'Jackson's article in the Hai-Orir'i 
Eduoatwnal lu-'V^' Slack and Porter responded 

V to specific Issues raised by Jackson in the areas 
of training for the SAT, predict Ion of academic 
performance, and aptitude versus achievement 
testing. They concluded with a finding made in 

• their nrlglnal .-^rtlule- "we hope t'aaL student-, 
will remember that [SAT] st:ores are unrelated to 
the quality of t]i»»ir nlnds." 12^)8,1:399) 



Additional Research on Special Preparation 
Sponsored by the College Board 

During the past decade the College Board 
h i:3 sponsored several studies to determine the 
susceptibility of the SAT to special preparation. 
Discussed below are the results of scudiei^ con- 
ducted bv Pike and Evans (19 72), Pike (1979), 
Alderman and Powers (1979), and Powers and 
Alderman (1979). 



The Pike and Evans report. — Lewis w. Pike 

and Prankliii K. Lv^ms conduct^(J a study to deter- 
mine the susceptibility of It turn foririaLs uii the 
SAT matheraatical section to coaching. Pike and 
E; vans • s re sea r ch bulletin. The h'ff^c t^' of Spc- 
3 1 at IruituKiction fov r'-'ivec Kindi-: of Math^jmatics 
Artltiide Itcmt; (May 1972), examined quantitative 
comparisons (QC) as a possible replacQjnent for 
regular mathematics (RM) and data sufficiency 
(DS) formats. The QC format requires examinees 
to determine the relationship ^ two quantities 
(i.e., mark "A" if the quantity in column A is 
larger; "B," if the quantity in column B is 
larger; "C," if Lae quantities are equal; and 
"D," if there is insufficient information to 
determine the quantitative relationship). The 
DS format presents examinees with a cjuestion 
and two statements labeled (1) and (2), with 
the objective being to determine whether the 
.uestioM could be answered by "A," one alone; 
"B," two alone; "C," by one and two together; 
"[)" bv eitlier owl- aione or two alone; nr 
"K," by neither statement alone nor by one and 
two together. Tlie RM format requires examinees 
to determine wiilch of five possible matliematlcs 
solutions given Is correct. | 223: 1-2] 
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participated in the ->rud\ . hi:;hl ^uDurhan id'^l- 
WfTf Locati'd in the viLisuts '>r '*r i lu l icn , \* ^ i^t- 

in we't)tfrn Pennsy I VrMU a . Ihc vo 1 uiiIul- r., wlt 
r.nidomly a^'t)i>;iied to twu in^^truc t luiuil '^rcmp > and 
{uie Lontr'>L ^roup. \ll tnrL'e ^roup-^ wure ^'^iven 
li hours i)t 1 n.st iTut t ion over st'ven Saturday mv)rn- 
in^s and about 21 hour'r> uf homework from workbook-). 
Of trie 535 volunteer^ pre tt-^ t u'l , fewtir than 10 
piTi^t'nl drc uptd ' I nT the pruc-ri"). jJJ^.i ll- 
16 1 A different n^tructional program was dt*- 
veLoped for each of the three matiiemat ics item 
formats, and pretext-) ind po-^ttestb v/ere adminis- 
tered, [225:51] 

According to Pike and F:.vans, results of '^he 
statistical analyses found that each of the three 
mathematics item fomat , i}C , P'^, and tOI, was sus- 
ceptible to speclai preparation, especlail> the 
complex ^ir nc^vel item formats. A further analy- 
sis indicated that the volunteers appeared to 
ha^'e leained basic mathematical concepts and a 
systematic appi >arh to the ct:>mplex item format. 
Pike and f\Mns reported mean i;ains of auiio^^ a 
full stand<ird Heviation for the groups i i^s t ruL t«. 
in the orplex i r eir forra.Us. This Jet them to 
conclude that thes» g<u n ^ wt^rt* "ot practical con- 
sefiuen<e ind likel ' to intluc e Ion 
dec t-ii nns . " I 22 ) : 5 ^ 1 



Th„# Pike report. — \nother stndv Lv>ndi.Ot».d i)V 
Pikr summ.irized rest^arc^n 1 i t *' r at 'j re i>n spei la 
preparatMui and testw i s.Mie-^s , PuhlisiKMl as .i 
'iiWle^k Hi>ard resoar'^h and development report 

• : ^ / . , -'^ ! ' r r . 

• , •> , ''' / * . . ' ;r* 'f ' '^!.*, stated 

that (pie^tionr. re/.ar1In^'. sp^^ lal i t rue t i t^n 
r h'' ( wete itlevanr h-^^ uise the (onl inning' 
por^anct -'t SAl >i ores pri">'-.nr>d st»«dents io 
"instMnMofi for the ^A^-Tr*'^ wh i ( h encour >s',ed < 
».u'r< ill (iMihifVti nnt i-\(MiM ses 
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rli'^ll( tTicl privitL ^Lh^u)l- t'l oMer n 
[/rv p 1 r 1 1 ) v)n . i 22 J • 3 | 

\<.(.urdin'^ t»^ Pike, e.^ef^t tor thy dirit-r- 
t-nc es in trie relative period ol in trUuLion, 
bt>ti» short-term instruction (Si I) atnl interme- 
diate- term instruction (111) trv to improvy, 
test Sk^ores LhroLi5:;h special i ustrijcti^>n at an 
accelerated pace compa 'jd to the amount of time 
norma lb' judged necessary for substantial changes 
to occur, lestwiseness ( HJ) allow -ndividuals 
to show their abilities to their best advantage 
through knowledge about test taking itself. 
[223:b-7i 

Pike reviewed 10 studies pert<iining to the 
mathematical section of the SAT. Seven <:f the 
studies (Dyer, French, Dear, Lass, brankel, 
Whitla, and Roberts and Oppenheim) indicated 
that score averages attributable to SIX were 
not sufficient to justify having stuaents m- 
vl' t ♦'Ime in this t^-pe of instruction to imprt)ve 
their tesL scor.-s. [ 22 3: 23] These studies re- 
ported score changes ran^-^; ^ '-li*'"^ • os » 
to i^iins 20 SA1-M points. In co-'trast, 
tiirec other studies (Marron. McCarthy, and PiKe 
aiul hvans) indicated Miat overall STI increased 
S\ -M su.^»-es significantly. The Pike and Lvans 
study estimated gaiii.-^ of about Ji SAl-M points, 
the MeCarthv study t)f abcmt Al SAl-^' p'unts, and 
the Marron ,tudy of about /9 SAT-M points. [223: 
2 3j Lquallv important, a comparison ot SA ■ 
an J SAl-V f rulings for seven studies t'[i<u re- 
ported the elfects of coaching and snort-te?'r 
mstrattion on hcH h (Dyer, Prencli, Lass, Me ir^ 
hrinkel, U1 i t la , and Roberts ana Oppenheim) 
found thi "SAI-V gains were -.ironglv e(]UJ cl- 
ient ft' tho^.t> oh'- TVed }tW the SAi-'"." lii*' 
i!i,;h, median, and h^w SI I erfeit-, loi th* SA!-S 
were l.T, b, ai5d -'J, re .pt^ t i ve 1 v ; tin cltt^.t^ 
f.u : rit» T \ 1 - V we rt t h , 11, irul 0 , y » ^. pr . t i v - . j . 

22K2/-281 <ivtiall, th». st'i...r nad siih^>tar.- 
tiill\ diilf'iMU d(->i>;ns ( f no.;"'r -^-ih- 
' t" t . , the Mso iM ^ ( >nt I ', s > ^ , ! ' a'> u • 
or pi't to .t a. (i post -t i a ^iat a . i ' ' " . ' ' 1 iMVo 
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-.If .-rtt.-r- '■••r iii- :>\l-"\ ("U l Ik Si I i-fi". .i, 
t<.r t 'ir S w -V ft' "unr.--." I '1 . *' [Ji): Jj ;t 
■5 'O'i it.1 ' e lU ' t d t [laC ^' ik f ' T I 1 tt' r alia t r . . ^ 

studv ( I I i!ul til' ^'.irrof. ,tud/ (I'.'t'S;, wli u m 
Si Ink ciiul ►'tc'T 1 - 1 It iMid._'d h.iVf b*.'t ii • lUd 

bv KI S ipii th»' CjJ B . 

\t tht--' V (un' 1 : I in 'if [lis liCtTcUure rtvit-w, 
Plk»L- rL'( ( )niiriL'ndt d that rut'irt- rf^o,irvri rt';.;aru i 
Sri, III, and (W -,htniiJ aLLenu)r to *ma\i'ni/:t' tiu- 
fiirnt'-,^ and valid if/ ol lac S\r '^ith regard to 
Its -»hc)rt-tt'rin anvl itit rmt'd i aiu - te rm instruct iun 
. . .srt>rt^ ( omjH nt-nt s ' ; foster realistic 

undt'i stand I .ind expt-o r it i L^ns rcK-'iftl nig pobbiblf 
out^ imt'^i of sn and 'it," ratiicr than dJsLOur.Jv;- 
in>; tf st re part^diu'ss pt-t sl ; and to pursue "a 
more hasic tiMde [ stand i n^; ot tho pTvicesses in- 
volved in test ti'-fink; <ind ct^nt r ihut i n>; to apti- 
tude test srore-^." ! --" ^ ' * j 

Short I V tircer the reli-ase of nis literature 
rf'vu ^LK.' .1. li n - '(! h , I ' . t's -I'.d -t 
the dismiss il result* d fro;i fmanci.il i..t'Mir'. nu 
was iiprelit '<i tf) f'lke's resr_-ircti. N(>w empioyed 
a-, -i ^tnu^r r-'S^Mrch e.->v)( late at tlu' N.ition.il 
[nstltutf i^f [•aliuatWMl, }'lk*^' st.ited h«i.t he be- 
1 Leve-> there is a link hot wren trie (ollt'^.t 
Boaril*:* re« t-nt st.itemerits rt^ardinij; "formal in- 
stri't r i'>n for th^ SM" and tiie KU's stadv uf 
tfu t'tti't^ «W . Ml till..' on St andard i /rd adni^- 
slop ex iin 1 riat I on ^ . ( 1 U) ^> | "I don't tiiink .i 
student « ai! arti^it i a I U- r.ii-^*" \\i .»'sr s(*»re-. 
ahn^' h 1 ah I 1 1 t V thr'Ui/t) rrst [^ref>a r 1 1 i on , " 
Pike *ommen^ed, "'^ut nt' rni/,ht hrin^ his >i.v^ri 
up to wh«Te hi. d) I 1 J t r e 1 1 ! , i • 1 J 37 . 1 , ] 



The Alderman and Powers report. — > t * » r r 

I ent Ntuiiv ( <Mnmi .^i o'rd h t 'le (''ll*';' Hoirij p. r 
t.unm/, in^rriHri-Mi ♦ir the S\l w i-. » leiantr 
l*)/u i«'>a.'ar'i! repirt h onaild I . AidetitM uid 
Don I hi 1. ! ts , - // ; ' • . •* - - 

'» A, ■ I" • ' T' . \ld»'i"i.in n)(i i^'Wei s 



X I 1 ' 1 1 a I 1 V ^ p a [; i p and t n r t t , a ; i ' < . < ' « 1 1 
^ I ' i . t !ia r Md ^;)r. « . a [ p r<L i^a t a L i » .i t ^ t it 
1 1 r I 1 a li) , 1 1 i I t . 113 / j i < > r t , t. i i ! a i 
.i: 'it - 'vr. r- in * t rt- tt in. -a r- n[ , < i^' ^ - ■ ' , 
1 . 1 '5Mt^ r< a ^r.'nn . ■ H. IJ - M j , ir i • : . ' 
t ; ' 1. V 5 1 n n t e r - • r . • M ^,a s i i h ) i < 1 i a o a - ^ ; r > i 1 1 a 
a cotlt'.^t prt I'a r 1 1 a»'"i(n'a i ' '-1 'Uai 

s ."le ► .[H-riLn^L in taki^/ v'^rnal ipticnat- tt-^t-.. 
; 1 3 . o , Ji j In nost l i^?. s an t n^; Lisa t v. .> '.l r \ i 
riMpon->Lh Lf N>r tiiu j. , truest im^, . ^^irt^r. ijl r. - 
V Lo/. books Ut ft .1 1 so ut 1 1 i / od . 1 1 J J a i 

SfVen of tne Li.',tit ->(.ho«,ls ^tudi^u « tloriJ 
^peeuii prt prir.tt ir>n prgyrams of ^rnsri di.rac.on. 
lite nunDer of hours devoLrd to ^pei i. 1 prt-nnri- 
tion ranged 1 re^ rive to II hours, A.th in av- 
L-rak^e C'f 8.3 tiours ^-f preparation, [hi ei'jt'tn 
S'.houl offered s[>tHi<il prepiration .f >onsider 
ahiv liJimer duration (A3 hours), w'rnwii irvr^-ased 
the avera^',e time devoted o .-,^.tcial prt'para t i r^n 
at ail of the schools to ij ii>urs. [13:^3] 

Results vi tht Aldorm^n <ind P wars stud\ 
rtveaU'd that -,pecitil prt [)ar<it ion for the b.\l-\ 
ran).;ed from -3 to -fJlf^ poincs at the (.•::f;rit 

■k-k 

-^(^hools. (i3:20] Itu ^iVt^r.i^e j, u n .'ttribut- 
jblt' to spucial prt [>ai at i< 'n wa^ ei^ht point-^, 
whiLh correspond- to ont- additional itom in- 
-.vt-reLi Liu-rectlv on the [ 1 3 • ^0 1 liu-v 

ob-^t-rved tn.Jt student- improved their perf>rn- 
in^ 1' m both ,m 1 1 < 1 OS ind intc»nvm<> b' (aie-nalf 



It should be noted that man% spe^ i 1 prt- 
it ' m ( oursf^ olfered b" < onurierc la 1 roa<ijin^ 
t-^'rprises tvp.icailv otfor p rt-p i r<i t i oti {or the 
1 sonit two (\r three time-^ lonKi'r i dur<iti<ai 
t.n I 1 ooven of tlie school proj^rans reported hv 
I it-rm.in and Powers. Of 11 eonunen lal ( o u h i n,; 
>. ,(Oi 1 , w^r wh K b lia t a wt re av 1 i ab I e , as r( - 
^rtt>(j bv tile Bostcai Pts.iopji ot trio I i( , 

L'io aveta;_^t iHiinber of hours devott d to spr^ lai 
aropifaM was about l^^ hour^, ^tar^h li . K m- 
ian (Si!!ool A m HRO's stud ) (Ulers 'd) I. nr-, .f 

e. > r t >Mni I !i >t ru( t 1 >n and 1 • s i i r t p.i ra i i on (. e n- 
r , r i 1 o} f rl s ' * b 'Ur .'i sp.M 1 i 1 

It ; i[ it ion, [•)(). 37-. ^o 1 



\t Ol d I iw: t o S ;^a< k- .ad f\ i t , 
1 - t ' > - ,( b' > 1 1 v,i» f a t 3 . 'U in p^ • ! nl ; 
! .! 1 t ! . r tJrtCO-. n t Oi ^,1' I 1 ! t , id 
i,*! a." i / )H lf)i) j 



I 'n i il ^'o 
1 1 nod M'UN t 
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lt»jm tMv ii , but li'.' ofUit-, • ir reidirK' i ^ ^n[> r« lu- ti- 
si(?n <ind -^entt'ut* Tip K' t i dh ^ct-j iu"^i i 4 1 b lt» . 
(Ijilrii In li<"t Liio^^ fMitiinv,,, MUeriruui .iiid 
Fowt'Ts sciitl that lodcbiiu' ;)r^).;r.i.ni-. din-ct-'d Li*- 
wdrd the SAl-V tc^U -./iTt "vin i a*.* t r t-L 1 1 vu -,|jt)r. -.e 
to declme^j ip -^tiidc'nt s-vwre-^ un lind tfst." 
(n-Ji; Noru'thi'lf , the authors -.tatod that it 
would r>^' I lui'f.prop r i«it f to make* i nftTcPLfs ba^^ud 
on their -»tiidv tor student {j* ^pula t luus su^h i-. 
mi nor I tv k^roup~>, tho-^o who laL^^'d PSAi fApuri- 
cucfi, and tho^u ittt-ndm^; sTialler st-condarv 
school I^atht r -n adopt ini> s[)t'cial tcjst pro- 
j^rams di r^ctt-d toward tru* S\r, .\Jderman and 
Powf.'rs rt'c or.Tmt'ndc'f] th.it <. ommuui t 1 1^-^ -ind sehonls 
concerfit'd witii -^tudt-nt p< ■ r t o riKinct' )n lue S Xl 
should 'st rouk^ thon tr-t regular { ur r i c ul unp . " 
II 1 



T a Powers and Alderman report. — in ord. r t > 

pt.)VidL -vcx i.ir ,<'i.Mn-^ cUUi .luudiLs with Wioit' 
Int orm.i r loii, t'lo Cul Hu.ird has dt>Vt>l(^p'd a 

- 1 r 1 • 1 1 h'). Kit't, I- ^- T, which ro- 

pii<«'d in .>ldt*r ^-ah I 1 i_at I on , • ' ' ,"\ Iht 
"t-w 'nth I } tf ♦^"^ '*T"W,!;ni"(i f aT)i 1 lar 1 /i'* c tn- 
dtdati'. wif i thL ^\] i.'d tin- o-U ut" Stand. ird 
\'rif(<ri I'l^'li n, . nh tns o tt'>{ t ik 1 n>', skills, tf- 
d',i<s t ii>j.-r,, hrl, stuslonf^ bc't^.jint' im^^* 

.^t'M ..wiM<l,"0. ''It* .^i-;aj,«> h'^^klot i.>ntnn^ i 
ti<"u;K>r.' .1-^,1. ^v;, ft'-' in,wtr-., diroctmn^, 
f,>r o'.r 1 t^Mt I u>' . It. a .'vT--., md stra^'i^i, , 

1 * 'f .,ut^ --s 1 'K' , nui 11 1 M.: t ' a i I ^ . j J J / 1 } 

In • :»'hrnjr. I ' T ^ r. stsirv h lopcrt t i t l-'d 

'] t ^ • , ' " . , * ' h ' , Pow» ' r > 1 lid 
Mdrrinan ti'pvotfi rh- r-'sulf-, la snrv*', ol -tn- 
dotit «U'inl"n^ r*^'.' ir .1 1 n,' tf.c u-.ciuinc ot * , 

't ' ami j^t»sr|'t.'d to rstimati' Ibo ottoi{-> 



Lhil I'll' booi^ lot Mas tnivo hid on to*st taKiti>. and 
ti t orcT. [^J7.1] Prt j<ub ] 1 ( at i cm lopii--. a" 

' 'I ia^ otb.cr matc-r i.ils re^uiarl\ 
,t at to to-,t r».v i ^. 1 1 aiiL s wLro mailed to h.ili ot 
I h« I aidoT. -^ar^pb. ot ^,02+ juniurs, while tiiC' 
rt'-.ui I'll 0" hill rct^'ived ihc m<ite rials re^,aliri.v 
st.it to r-gi^t rants plus lli-r ti^ .V.*, rather 
tJMit t..-' new booklet. Of the -students 

resfaajdmg to the } v)wers and Aldotman -.arvc'\ , 
about 38 percoPt re'ported readin,; '/ : ' '\ n- 
^oriipK' tol y at least, once, mother third ttad most 

It, and 28 percent either ski rune d the publi^a- 
tLon ur read [)art^ ot it. Less than throe per- 
oont made r ) use of the booklet at uiln re- 

^:ard to tho sample tc-.t, P(iwers and Aldernan 
lound that it was not Uc>»'d as widely as the toxt . 
\bout 7/ peri on t of the --tudents reported at tempt- 
in;^ at le.ist part of the to^t, while 36 percent 
.ictuail/ ( ample ted it; 2i pi rc».nt did not under- 
take any of the (juestions. [22.7 : )--^ \ Ne^rlv all 
ot tht oApe riPienta I students (^6 pert».nt) felt 
that hid hei}.;htened their rware- 

noss of what to fX|t(n on tne S\I. Most >tu- 
detits (7b p*'rccnt) .il^ti felt that Miev had 
*j;u{iod nor'.* se I f-conf iden( e hi cau->».' o! tho hook^ 

But a ({)mparL^"n of the te-^t s. ores cf 
th'-^^' wb.o wer* sent tlu new hooKlet t^ tne test 
St tr^.'-. of tJe .'andiin. .,i^*nle wh n h did not r*'- 
c 1 ve the te^t [ oc>M»'i sm *ed no djfN'rfntts m 
tae t'. t i^ores ot eifhor rou,. in th. v^r >al or 
:ut ..e^".at ic al stilimis ot trr SA i to ^-n tne ii-.t 

-^tand ir<i Nfitten hT^v;li''h. \J2/\2-^-'^] 'riven 
u rie ra r' >ni' 1 nl e t e L ami ni^; se« ' -nd 1 r'^ s^ ii o Is in 
>p»'CUtl prepnarii' , Towers i[id \idenian I'mi/'!- 

- 1 ie r ;r »u;i adr.o M i s t r 1 1 1 ( n 'M t Jn .am^' 1 1 t e : a . 
ni 1 . f , r n 1 1 i \ ' t " > . ■ m on ra 1 li/, . t luu wt . t . ' '!''"!> r 
r ir t I • K t * -t ' !^ f t It 1 r I >wn , ' 1 ' / i 



St ndent who r ♦ < e 1 v ' < > ; ' - > ' a r * id 

nion i * d I ' 1 : , ' >! 1 ; [ . a i 1 ; ; a Mm l t 1 1 . ; , , 

Mroballv will n-^t nm fi 'o pi^p«r» !>a the 
test." 1 II. M 
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Summary of the 
Special Preparation Controversy 

rhe initial staiy bv the Boston KeKiunji (Of- 
fice of the Federal Trade Lommission, Ti* z/'/V-^* 
of Coachzrij on Jtandav^iiy.K'ii \<Jjvrij^->'on tlxiJorciKi' 
tiona (1978), found statistically significant 
differences between the SAT test scores of coached 
and uncoached students. [90: Ij It was estimated 
that students attending a commercial preparation 
course wno were coached four hours a week over a 
10-week period could improve thL." total SA'I 
verbal and mathematical scores by as much as 100 
points. [188:102] Citing major deciciencies in 
the BRO study but using the same data base, i 
report by the Bureau of Consun^r Protection ot 
the FTC (1979) found that a certain class of 
students Identified as under ach levers , or stu- 
dents who tend to do poorly on standardized 
tests in light of their previous grades and 
class rank, could improve their SAT verbal c.nd 
mathemat ical scores bv an average of 25 test 
points in each section of- the test. [ 89 : i ] A 
reanalysis of the 1979 FTC data bv the National 
Education Association showed that students who 
received coaching between their PSAT and first 
SAT or between their first and second SAT experi- 
enced score increases between 104 c*nd 143 points, 
conpartd Co an uncoached grt>up. [194:25) Accord- 
ing to Slack and Porter, p:iS*s studies of spec lal 
-treparation prior tt^ [^^^8 indicated that c oac heel 
students ccKiid raise their scores by 1^ points 
on the SAF-V, ct)mpared to 40 points in studies 
not cited by li|S . Slmi)arlv, In studies of the 
SAT-M clt?»d bv FTS , students could raise their 
test scores, on the average of 12 ta|?st points, 
compared to 5 5 points In studies not < ited bv 
ETS. 1258:1811 

On the other hand, KtS^s rcanct lysis of the 
FTC data found the effects oT coacliing to be 
less than both the 1978 BRO and 1979 BCP studies 
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due to the combin . effects of coaching and self- 
'^^'lection. After taking into account differential 
growth and motivation, ETS observed th.it the ef- 
fects of special preparation were approximately 
11 poiits for the SAf-V and 30 points for the 
SAT-M. [177:6] ETS stated that the findings for 
comjBerciai coaching were consistent with orior 
studies on r.he effectiveness of coaching. More- 
over, score increases of 20 to 30 points on the 
Col lege Board 's 200-to-800 point scale wei 
equivalent to about three additionaJ test items 
correct, a gain which students could expect to 
obtain by simply devoting additional time to 
their academic u{)ursLs . [177' 7 J I'lrn^r puhln. i~ 
tions and rest^jr^-,'^ sponsored by the College 
Board pointed out that schools and communities 
interested m helping students prepare for the 
SAT would benefit by strengthening the existing 
curriculum and administering the practice te^t 
contained in the CEEB publication Tju^'^^j th^. 
JAT. [13:21; 227:26J 

Despite previous research, or perhaps be- 
Cfiase of these widely diver>'.ent tindin>;s, the 
C'. .telling controversy is not expected to subside 
quickly. In fact, there is evidence that inter- 
Lt»t in coaching or spe':ial preparation for 
standardized college admissions examinations is 
increasing rapidly. According to the Boston 
Regional Office of the FTC, an induG try-wide 
structure now exists which would allow coach- 
ing schools to reach the 2.5 millior individuals 
who take standardized admissions xami.iat ions 
annually, with av estimated sales potential of 
one-half billion doUara. [90:35-36] Addition- 
ally, some colleges and universities are now of- 
fering te^t pre pa "at on programs for students. 
St. Iohn*s Univereitv in New York offt^rs a $125 
coach ing course for students planning to take 
tlie SAP. '[247:2] Rutgers tmiversity offers a 
special preparation program for students plan- 
ning to take ^he haw School Admission lest. 
I 2 37:1 , 20 J Ha r court Brace, Jovanovieh, Inc. 
a $300 mllMon conglomerate, has acquired a 

L ' 
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CO ichm^ ~>etiuui. \'H) if) j itib.ink ha-> iuruui Lht 
SH<tf>n bchu(;i t-' .'Tt-uart^ it-> t^nplovtics tor tht 
(/T iduate Man.i>»ement Adimssions U'-.L and tfie 
[2)7:1, J(J I Nk\ n<is prepared a -^i.intlard L/.ed 
te-^rin^ kit for its nit'nbers, wiiKti contains a 
list of rei„«)mniendat ions ft;r part^nts im^re-ited 
in findiri^ sped":! rjreparitina for tieir child- 
rt-n. 1201: 1] Ti 'j Nat iv nal Lnr.ti^:ute of Tduca- 
tion has iridLcatod an mterebt in ojannmg a 
conference to assess the effects special 
prep<iratLon on stadeats who take tlje SAI . [ 247:2] 
I he Federal 'Irade Conuiiiss ion is eontinuin^ to 
monitor the advertising claims of i oinme r c i a 1 



tnLerpris<s. [112:/] in IV 79 liw h'- 

;)<irLi'<.nL ^Jl lieilLii, LuuctiLiUu, tiud Ittlt^.r^- .V. t 
aside tiiilliun to tlie ile.alLli Resource^ \d'.iin- 
i-.tr it ion otfice of Heaitu ResourLes opporti. it> 
t ' ;)ermit disadvantaj^L - sLudeat^s interested in 
he.ilt 1 orofessions to i)e coaChed at 21 universi- 
ties. ( 2 37:1 , 20 j According to an EIS survey by 
Mderman and Powers, nearly one- third or 54 of 
175 [)ubiic and private schools in seven north- 
eastern states have indicated that the\ offer 
spet lal courbes, eleftives, or extracurricular 
.ictivities for students who wish tc prepar^f for 
the verbal portion <^r the SAI. [13:4] 
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THE TRUTH-IN-TESTING CONTROVERSY: 
CONSUMER RIGHTS VS. GOVERNMENT INTRUSION 



i ruth-in- t<.'st i n;< U^i4i-> hi 1 1 cmi is cs^t-nt lai I / 
an issuf t>f consumer rit<hts VtTsus guverniiient 
intrusion in t^ducat iuii. riiis ie^hJation is a 
response to consumer desire tor ^nure i n ormaC ion 
about the uses and results s tain' ird Lzed col- 
lege admissions tests. {^ro|H'?rtfnt s of truth-in- 
test le^i l^il^ ion assert th it tr\e\ sn<"ild have 
the same basic rii;ht in 'jbLiininK te^t scores, 
test (iLiest i<in-» and answers, and studies related 
to ct) liege -idmissions as tne\ have in obtaining 
Information conlamed m school tiles, credit 
reports, law vnft)rce!Tvent records, and j;overnmetit 
files. [226:1] Hiest test consumers ar^ue that 
because of the ambiguity and mystery sur r.Jimdi nj^ 
standard I /^4j»d testlti^i, tiiev s'nould have tlie rl^ht 
to examine test-» to i ->ure t il scores are a( cu- 
ratelv computed and r-^iorted, [132:1J i.eglsia- 
tion mandating; the disclosure of test questions 
and answers after an examination is neces->arv, 
they ar>;ue, in order for people to know how the-/ 
are being rated and judged* {98:11] Advoi ite^ 
of truth- in- test lug oelieve that legislation 
will ^^rovide the following: 

l» Increase the public's understanding of 
Intent mi llmltation.s of tests; i 1 30 : 3 ] 

2. Alleviate bias and promote account a. litv 
in the standardized admissions prcnes^: 
|292:2i 

3. Permit sfidents uo learn from reviewing 
their mistakes and pro'Mdt- test -taking 
assi >tin(*e to those wh(^ tannnt aff(^rti 
to attend eKpenslve (.»a(liing s h'>ols» 
(292:31 
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Keduce the r I of eomr>uter error caus- 
ing a I -.t- taker t*' be incorrectly' 

5, Improve the ijualLt> of hotri the tests 
and public debates surrounding tnerr;. 
I221:3i 

\dv K.ate^ ot testing legislation perceive lI as 
^trengtrienm^ tiieir "right-to-know" ^nd making 
the testing agencies "accountaM.' for a service 
^urcnased by millions of individuals lanually. 
!z8:2; 22b: 2] 

Test sponsors and test agencies, on ti>e 
otner hand, tiave expresse<l con s.aer able alarrr 
over lawij whXt^h mandate the release of test (-jues- 
tiuns'and answet-^ to ♦^he publxc» Measures call- 
ing for the disclosure of secure tests, they 
argue, are an example of unwarranted government 
intervention intt^ educational affairs and an 
attack on the entire t allege admissions process. 
I 2/ 5:4] iesting agencies emph<isize that trutn- 
ip-testing legislation will make it nearly Im- 
p.'ssib'e for therj to continue their current pro- 
^r IPs and level of services. 133:1] liu* dis- 
c 1 osure ot secure teeJ t ques 1 1 ons <ind <inswers , 
m{*reoVer, will irrepaf iM'. bar:,' c 'jiiaiitv 
of the tests. As a result, r / colleges and 
universities may lose coi.t i 'lence, i n tije <ibility 
of the tests to predict the future academic per- 
t orm^ince of students . [ I 38 : 19 ] lest sponst^rs 
and test agencies contend that dist.loMire will: 

I. Destrov the seturit*. oi ach trst .ind 
make reuse impossible; (46: 1| 
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2. Increase costs of test development and 
reduce services to clients and students, 
[^6:21; 

3. Pressure teachers to teach to the test 
and increase coaching activity, [46:ij, 

4. Ignore the diverse nee Is of test takers 
who must have access t) examinations at 
different timeo of the year, [72:2]; 

5. Lead to limitations of educational op- 
portunities for minority and disadvan- 
taged students, [46:4]; and 

6. Violate test organizations' Fourteenth 
Amendment rights, as well as otht-r pro- 
visions of the United States Constitu- 
tion and the New York State Constitution. 
[52:1! 

"In this war, directed agairst testing as its de- 
clared target," stated ETS president William 
Turnbtill, "the traditional approach to intellec- 
tual debate has been shunted aside and replaced 
by political advocacy," [68:2] 

Testing organizations have stated that they 
support more openness in testing in principle, 
,->ut prefer to implement changes in standardized 
testing voluntarily. [63:1-2] Hastily enacted 
testing legislation, advanced under the fraudu- 
lent title of truth-in-testing, they maintain, 
is itself a "consumer fraud.'* [231:190] For 
th^^'se reasons, t ruth-ln-testing legislatJ^Mi re- 
mains a hlghl'/ controversial issue. 

Origins of New York's 
Truth-in-Testing Law 

though California enacted the nation's 
fir<;t law requiring test publishers to disclose 
Infoi'mation about a test (September 1978), 
New York's t ruth- i n-test I ng law is more compre- 
hensive in scope and broader In influence. 
Specifically, the New York law requires test pub- 
lishers to disclose actual examination que-.tior^s 
and answers to test subjects, upon request, 30 
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days after the release of test scores. [i3:7J 
!.eaders in the enactment of the New York legis- 
lation were Senator Kenneth P. LaValle (R) , 
Chairman of the New York Senate Committee on 
Higher Education, and Assemblyman Albert Vann 
(D). [175:1] 

Ihe legislation was the subject of inten- 
sive lobbying during the New York Senate Higher 
Ed ucat ion commi t tee mee tings . One educational 
news service referred to the impressive array 
of advocates and equally formidable opponents 
as the "War of the Worlds," Supporters of 
LaValle *s trurh-in- testing measure included the 
New York State P. T. A., ;^Jational Education As- 
sociation, New York State United Teachers, New 
York Public Interest Research Group, National 
Association for the Adv£:ncement of Colored Peo- 
ple, National Conference of Black Lawyers, and 
the Attorney General of the State ct New York. 
On the opposing side were nearly all major test 
sponsors, administrators, and organizations, 
including CEEB and ETS. Many prominent college 
admissions officers and the New York Coiomissioner 
of Education, Gordon Ambach , testified agai»ist 
passage of the proposed legislation. [145:33; 
211:4; 36:2] 

New York governor Hugh Carey approved the 
Dill, 3200-A, which added Article 7-A to the 
Education Law, in relation to standardized test- 
ing, on July 13, 1979. The law became effective 
on January 1, 1980. It applies to virtually all 
college and graduate school admissions tests, 
including the PSAT, SAT, ACT Assessment , GRL, 
Medical College Admission Test, Dental Admission " 
Testing Program, and thu LSAT. [36:1] The leg- 
islation does not apply to any state, federal, 
or local civil service test; any ttist used 
solely for placement, c red l t-by-exami na t i or., or 
otb.er nonadmission puipose; or nny test devii.)ped 
<ind ad.nini stert'd by :n indivldanl school or in- 
stitution solelv for its own purpose. |264:l] 

^.^ 
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Thf (ollet^e hntrance KxaminatiOM B(rird, thu 
Kduc at Dnal Testing Servxce, an J the American 
College Testing Pru^ra^ iridicat-jd that tht'> iii- 
Ll'P.vJ L ' 1 . Alt t K I r i- i.i'/, 'i''\t. < I, 

many test spon-^ors navv withdrawn th-ir te.sts 
from New York. Fht- iruijonty ol t tests are 

relumed to the health profession, and include 
the .New Mediral College Admi^->ioas lest. Miller 
Analogies lest. Optometry Coile>:e Admissions 
Test, Pharmacy ('ollege Xdmi s ions lest, and the 
Entrance Fxami nation for S^n(jols o^" Nursm^;. 
['i4:45-'*Oi pared with the lar^^e aumbers ci 

candl.Jjtes takin>; the SA I' tind AC I , most of the 
test pro^^rams withdrawn from the state are 
gi.^ii to small numbers of persons, e,^,, six 
of the tests are administered to fewer than 
SOO i-andidate^ a year. (230,11 

Provisions of New York's 
Truth-in-Testing Law 

The New York law demands full disclosure 
and requires testing ai;encies to provi^^e tests 
for public review. Highlights of its provisions 
tn relation to s landa rd i 7ed testing follow. 

The test i^enc^ must file, within 30 da>s, 
a copy of all ttst questions used in calculating 
the test subject's raw score; the corresponding 
acceptable answt ro, td those questions; and all 
rules for converting raw scores int, those scores 
reported to the tc^st subject, together with an 
explanation of such rules, 1264:2) 

Within 90 days after filing a standardised 
test, the test agency must provide tiie test taker 
with the opportunity to secure a copy of the test 
questions, a copy of the test subject's answer 
sheet, a copv of the correct answer sheet, and a 
staemcnt of the raw score used to calculate the 
scores reported to the test subject. The agency 
may charge a nominal fee for providing this 
Information, (264:2j 



,\lon4 'with the regi st r<il i oti foT >r .<rt 
re: ort " a Lest, e-it h ttst a^encv nust ^^ivl 
the l: o 1 U>wing i nf urma t ion : 

• The purposes for vhKii the Cent i i.on- 

• St^itements desi^^ned to provide infj rela- 
tion for interpreting test tci^ults, in- 
cluding explanations of tiie test sc-Te 
.->c<ile, the standard error oi nieasMremen t 
of ttie tes t , and a list of ava i lah le cor- 
relations between test scores and grades, 
successful completion of d course <^t 

3t udv , and parenta 1 income . 

• How the test scores will be reported, 
wlietlier the raw test scores will be con- 
verted m an> way before being reported 
to the te^t subject, and if the testing 
agency will use the test score either 

by itself ^^r vith any other information 
a'k7ULiL jfl'ic tc^t subject to predict appli- 
cant 's If utu re academic performance. 

• A de/cription of any promises that the 
test? agency maRes to uhc test taker re- 
garding accuracy of scoring, timely for- 
warding of information, and oolicies for 
not if ligation of in'^r ;jracies m scoring 
or score report i..g, 

• Wile the r test scores are the property of 
the ttst subject; the time period during 
which the results are retainea by the 
test agency; and clarification of poli- 
cies regarUihg storage, disposal, and 
future use of test score data. 

An individual's score shall not be ril«^a^^e«. 
or disclosed by the test agency to any person, 
organization, corporation, association, college, 
university, or governmental agency unless spe- 
cifically authorized by the test subject, A 
test agency may, however, release all scores 
received bv a test subject on a test to ,Ji,vone 
designated by the test subject to receive tlie 
current score. [264:3-4] 
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Major Issues Vigorously Debated 

In an article in Jo^vra^Jt, Rexford Brown, di- 
rector of publico. Lons and user products for the 
National Assessment of Educational Progress, ob- 
served that truth-in- test ing "is a complex ^osue, 
touching explicitly or implicitly on many educa- 
tion subissues that have polarized Americans tor 
generations." 133:7] Advocates of truth-in- 
testing who rally around the principle of fair- 
ness, and testing agencies that cautivm about 
the unanticipated consequences of tiastily enacted 
legislation, are often arguing at each other 
rather than with ea»*h other. Brown stated. The 
antagonists seldom draw upon t^e sarae facts, ex- 
amine the same aspects of eaucatioji, or subscribe 
to the same beliefs about the function of educa- 
tion. Accord insr to Brown, the debate about the 
need for and the impact of truth-in- testing leg- 
islation centers on four major areas: (1) the 
role and power of testing organizations; (2) the 
nature and quality of standardized tests; (3) tie 
need for state and federal legii; lation; -Aid (4) 
the consequences oi full disclosure provisions. 
[13:7-8) Specific issues that relate to tne 
SAT, ACT, and t;uth-in-testing legislation follow. 

DIsclosura of sscure test questions and answers. — 

CritiCi? of st.mdardized college adnusjio testb 
maintain tnat disclosure of secure test qi♦^>ti^n^ 
and answers will increase knowledge about the 
teats and will permit test subjects to view the 
criteria used to evalaate rtieir abilities. (266. 
13) In testimony before thu New "lork State S^-n- 
atc and Assembly Higher Eduration commit t^eb, 
Lewis Pikel former KTS researcher and nf'^t >enior 
aaso*. iate at the National Institute ot Kducation* 
stated that college admi ssh>ns tfsts ,.re a criti- 
cal public trust and the assumption tlat students 
who want to set thf»lr rests must demonstrate "tiie 



aced to know" was ifiappropriate , |22^+:2J Pike 
strortgly endorsed testing legislation, ^aymg 
that it would "provide a source and motivation 
tjr quality control that is simply not oLa- .wise 
present, riowever well-intentit)ned the test pro- 
ducer may be." [222:2) 

Among tne most ardent supporters of truth- 
in-testing ^ ^,islation, the New York Public In- 
terest Research Croup (NTPIRG) asserted that 
the disclosure of test questions and answers 
will improve tl quality of question writing. 
Subjecting test questio'^s to. scrutiny by subject 
matter experts, educators, and the public will 
reduce ^he extensive criticism of the scientific 
accuracy of test questions, NYPIRC; believes. 
Public disclosure is essential because of the 
controversy in academic circles surrounding 
the "correct answers" on standardized tests. 
NYPIKC cited che release of a secure ETS test 
in 1973, a Multistate Bar Examination (MBE)- 
Following the disclosure of the test, law pro- 
fessors at Georgetown University and other 
Washington, D.C., institutions expressed dis- 
agreement on the ^'correct answers" to 25 per- 
cent of the questions. According to NYPIRC, 
ETS and its clients agreed that five of the 
questioai> appeared to have more than one correct 
answer. Sincer 19 73 no other tests have been 
divulged, NYPIRC said. [209:3) 

Proponents of standardized tesLing, however, 
have claimed that the public is be:ng deceived 
r>y false statements vh^ch misrepresent the role 
)f Lest agencies in American education. Ihe 
i>ublic is being misled by loaded words like 
' Lruth," "fairness," and "public interest." 
1118:12] Secure testing programs arc not -secret, 
according to- LIS, but are essential to inr>uring 
fairness. hi S reported that by maintaining the 
security of tests it can do the following: (I) 
f^n-;urt' th.it .ill students receive tqutl treat- 
mi'fit and th.it no one iia-. <in unf <u i advantage bv 
seeing.', a test lo advance; (2) reuse ti'sts .ind 
keep down the cost of development; and (3) 
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equate scores, between difterufit test ediciuiw, 
thereby assuring that students Cake le->t.^ of 
similar difficulty. [63:1] 

While many testing agencies sup;..urt the 
principle of openness in testing, thev claim 
that t ruLh-in-test ing legislation is unnece^:. - -^y 
sinct intirF'ation about tests is widely dissemi- 
nated artd avtiiable to both students and institu- 
tions. LIS pointed out that it provides sample- 
tests for tae SAT, GRi:, GMAT, arid I SAl , sends 
scores and an interpretation of their nieaiUug 
to students, • 'P^ard-, t'-->L f'^-iii-, i'- id ,i iinii ,t<^. 
only with the student', permission, .->urrjnar i zes 
statistics lor the j^ress and state polii,v 
m<tker.i, and publi->hers research la profes- 
sional journctls and magazines. Additionally, 
students are asked for advice on how to improve 
programs ind services. [65:1] With legard ti 
NYPIRG's criticism of the Multistate ' ar Kxair.x - 
nation, ETS said that th^ complaints stemmed 
from a single law professor writing one article. 
Since 1972 more than 59 actual MBE questions 
have been released and are available in bock form. 
Sixty questions from previous tests are in the 
candidate bulletin. (70:31 

In a statement opposing New York's joint 
Senate-Assembly Btll 5200, the College Board em- 
phasized that the disclosure of secure tests was 
probably one of the billVs moqt harmful features. 
The College Board said I hat security measures 
are necfssifv la .■rd-.r t^^ pre-'t^nt sLutieuLs t roi 
gaining access to the tests. If test security 
were broken, then the tests would lose their 
value and ijirness and new tests would have to 
be created. (5 I] Advocates of testing legis- 
lation, the College Board said, failed to under- 
stand the nature of the SA'I . The SAT me.isures 
developed reasoning abilities in English and 
mathematics; It is not based upon <\ specific 
vtitrlculurr. or a set of (ourscs. Consecjuent 1 v , 
te^t takers cannot *' learn*' bv viewing mKs takes 
on their tests. Tlie system^it ic dlsclo.sure of 
seriire te^t quest iuns, moreover, could Ijarm the 



quality oi the test.-. i.._Lause ol Lhf time in- 
volved in pr. -testing quesLu^ns to weed nut a' , 
p(),iible cultural ambiguity or bias. [^b.'i-^J 

A. I 0<.tober 1979 editorial in the \ - 

I . ^ suggested that the underlying premise 

of testm^ legislation was that the and 
oth.t, r standardized tests victimize pv)or ana 'Min- 
ority students. Ihe editorial stated that sucn 
teot may not med.. are th^ academic potential 
>-^0ine s tudent s , poor , minor ity , and whi te , be- 
Ccjuse their intellectual growth iiad been stifled 
b> inadeq late elementary and secondary scliools. 
"The fault is not in the tests but in the schools," 
the editorial concluded, "and good admissions of- 
ficers t^ke that into consideration." [27V:A1JJ 

Commenting on the imp ict of the disclosure 
provision, Ceorge Hanford, president of the Col- 
lege Board, said there weie serious differences 
of opinion regarding the value of publicizing 
SAT questions. Hanford added that the release 
of each f rm of tha SAT after its administration 
was "wasteful, educationally questionable and 
of little benefit to students." [51:3] Other 
representatives of testing organizations and 
college admissions officers expressed similar 
Sentiments. Fred Hargadon, chairman of the 
College Board, expressed doubt about the SAT's 
ability to survive repeated test disclosure 
without ra sing "serious questions" about its 
validity. [138:1] Repeated disclosure of 
secure te-it questions, according to K' chard 
KergusoTi, /AC*'-president for research and de- 
velopment at the American College Testing Pro- 
gram, may weaken the ACT battery since it has 
stronger ties to the curriculum. [140:10] 
A cording to William Fi t zs i.nmons , director of 
and(»rgraduate <idmissions at Harvard, test dis- 
( losure mignt enable ;u>me students to b{)ost 
thtir SAl scores. Conse(juent 1 y , Harv ird j>lanned 
to look "hcird" at tiie predictive value of the 
SAI to see if it Iwis declined. Another ndmis- 
si,i)[Ks oft i(i r, ..awren(M' Momo, assoc late direc - 
tor of <idmissions at (^olumiii.i I'niversits, noted 
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that t'-.'-.t (Jis. 1 ;s'iro wnuid prompt Lolumhia to 
exdmini'' SA I ^. oro ^ in i diftort-nt w.iv , ^uL now 
d 1 f f L'r^'{\t 1/ rt'iTunru'vi lu* ^uck | 138:1*^1 

Die full in])<h c ot t'le tL'st disclnsuTL' 
pr()Vi->i »n of j'urk*^ 1 1 ult - 1 tt ^t in).; Liw i 

nut t'Xpe( ted to en-att fi>n(era cm LoIIe^L- i. .im- 
puse^ until .ifter fill recruitment. At 

th.it time cuLlf^e-. and un i >/er-s ' t les will have 
to asse-is whether ^tud»'nt^ are affected by the 
SAl's d i^,L losurt' . Some h.ive expre.ssed concern 
that unless te.ir-, (oneeriung the potential ef- 
fects of lest disf K>-,uri' are allayed, manv col- 
i^le^es and universities Tiav lose cent idenf e in 
the S\!, reg.irdless of whether its v.iiidit/ xs 
actually impaired. |l38'i^H 



Cost of test development- — ihe .ost issu* was 

one of the primarv objettioas to t rut ii-i n-tes t - 
ii\'f\ le^^isiation r.iised hv the test m.inul ac t urer s . 
But u cord I Hi', to S.-natur I iValle, testing agen- 
cies' t. laims for isicreasinv; costs were based ou 
the false assumption tliat the hill would re^iuire 
th.e creation of sep. irate tests for New Yorkers. 
LaVaiie i_ont ended that there «-ab no j us 1 1 f leat ior 
tor test agen( le^ i» increir.e the costs of taking 
rests m New Yr.rk f<^r tests that are ..dr i n i , t e r^ 
[lati >nwide. ii'")i:h(Jj \ito Perrone, dean of the 
Tenter tor '^'athirv; and [.earning .it t'ne I'nivt r- 
sitv of Ni>rtti Dil- iti, th"Ught that there was ,s 
degr*'(» of mtiniidation present in thi' threats 
of thf> test T.aki-rs to tr4'hle (cjsts and redu( c 
test admi i.tr<itions. PerVone said that dire 
( tinsequetu es nted luU [)rL'V.in unless "tlie test- 
ing industry refuse^ to bring already existing 
knowledge ^ind fre~>h < ommi tment to hear >■ . ifu 
new ( i rcumsi ant es" o' west dis'losure. 
Shirley rJiLsholm (h-N.Y.K -ns. . . M i i- 

eral t ruth- i n-tc st i ng h i 1 1 , <isserted that "p'-^^" 
pleVs lives ari' m(^re iinpoitant th.m cost." 
[J)():A27| 

Citing KTS's own internal studies, Allan 
Nairn and Ronnld Brownsteln noted that appr()xi- 
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"iuC<..ls five [jertenl of eacli studetit's tu fee 
I applica tu test dc'velopnient and Delw^eii 2 J 
,er<enL vind 11 percent of Jie fee is apj^Iud 
t>' hl^'s profit ma:gin. Due to the New York 
iesi^i'^t 1 IS bar. estimated Lnal ttie iddi- 

tUHUil cost for developing new SAI questions 
is ^ I ,0*^2 ,000 . According to Nairn and brova- 
•>tein, tnis estinuite provides b IS ^lud the Col- 
leg" Board with a million profit. 

NYFIR(. also alleged that bTS's estiT.ate of 
tesc development co.sts is highly inflated. 
NYPIKf. ci. limed that a January 19 72 LIS "activ- 
ity anal vs is" showed that the actual cost of 
developing the SAI and \chievement tests w.is 
32 per test. lais amounted to f^.b percent 
.'f the total cost to IliS of administering tne 
test and t,mly D.7 percent of the fje paid 

DV the candidate (^3,7!)), Ln contrast, the 
profit margin taken bv ETS avA the College Board 

on these tests was :?.9J, or 16 percent of tne 
f 

candidate's fee, nearly three times larger than 
te.st development spending. [209:4] Table 15 
shows how much of a candidate Vs fet ^oe^ tu 
test development, according to N>'P1k(». 

Acw)rding to NYFIRf>, figures from 1975 and 
19 7b showed College Board profit margins between 
22 and 17 percent. [209:3) lable lb gives the 
admissions testing program revenues and expenses 
from 197A-73 to 197b-77. 

I ah If 17 sht^ws i.IS test de . c iof^-^ont spend- 
ing as t ited Lv NYPlK<-. In 197b tIS spent 
^j9l,iM}{) on SAT XcUievcmetU ti'st i ons t ru^ t iini 
L - pi' OSes. Ih's amounted to 2.3 peMeUt of the 
i'*?b s\r Achievement progr.im in<oriie t rtim student 
u-*-,. Ip \ U7 1 IS budgeted SJ89,00i) on test con- 
,t ruction, "r i.l percent of exiunted program 
ir.come. Since most test qeiestions <ire newlv 
written, ai\d ii,:ve been for ril iK»st 30 years, 
NUMK! s.'id that there wa-. no <ipparent lack of 
hign~(}u il Itv (piestions av.u lable to test m*ikers. 
( oasetpicnt 1 y , blS's claim that test constru(tion 
tosts would escalate he<au.e new tc^t (}Utstions 
would h.ive to be coiistructed -.Oemed hi^dily 
impUusible. 1^09:3-4] 
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TABLE 15 Comparativri Analysis of Program Costs by Activity, 1970-71 



Test Program 


P'ee I'aid by 
Cvindidate 


Total Cost 
(per session 
Candidate) 
Incurred by LTS 


Cost of 
Test 

Development 


Test Dev. 
as % of 
Total ETS 
Cost 


Test Div. 
as Z of 
ree Paid 
by Cand. 


SAT and Achieve- 
ment Tests 


$ 5.75 


$ 4.82 


S .32 


6.6% 


5.7/. 


LSAT 


13.50 


10.83 


.49 


4.5 


J. 6. 


GRE 


8.00 


7.17 


.62 


8.6 


7.8 


ATr;SB (now CMAT) 


10.00 


9.22 


,44 


4.8 


4.4 



SOURCE: 



"Activity Analysis," Internal ETS Study, Jan. 31, 1972. 

Reported by New York ^ublic Interest Research (;roup. "Statement of Factual Correction 
and Rebuttal to Educational Testing Service Memorandum in Opposition." Albany, New York: 
NYPIRG, May 197^, p. 5. 



1974- 75 

1975- 76 
*1976-77 



TABLE 16. — Admissions Testing Program Revenues and Expenses 



Revenues 



Expenses 



Surplus 



S16,036,276 
16,260,652 
17,640,000 



$12,550,541 
13,232,474 
14,099,000 



$3,485,735 
3,028,178 
3,541,000 



Percent Prof i t 



27 
22 
25 



^projected 

SOURCE: College Board Statement of Revenues, Expense and Fund Balance, Year Ended June 30, 1976, 
with Comparative Figures :for 1975 and 1977 Current Projections. 

Reported by New, York [\ ^ic Interest Research Group. "Statement of Factual Correction 
and Rebuttal to EducatJonal Testing' Service Men.orandum in Opposition." Albany New York- 
^ NYPIRC, May- 1979, p. 5. . . 



in response to allegations that test costs 
are highly inflated* the ColiKge Board stated 
that Its [jistorlcal poliey his been tu make the 
SAT widely available to iu^ii school students, 

id at the least possible co^t. Testing legis- 
lation suggests that students should pay more 
and forego the greater availability uf testing 
in order to have the opportunity to view their 
examinations, the College Board said. Addition- 
ally, It was noted that there has not been any 

o 
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substantial demaitd from test candidates, admis- 
sions counselors, or officers that would warrant 
this "trade-off." [46:2-3] Alice Irby, an ETS 
vice-president asked, "Where is the equity for 
m.iking all pay for what few may want/" f 133:2] 
In response to the charge of excessive pr-ifit, 
ETS said that the College Board shows a 0.8 per- 
cent "profit" (».xcess of revenue ova expenses) 
for the SAT and achievement tests. This amounted 
to $155,000 in, fiscal 1978. The "22 poicent 
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1.\BIK 17. --MS lt-,t DevL'lopmonl Spt'adjri/. BrL-akdo^n and Bud^^t-t 



h'^l " ' " I-^^t Tost 

iest ['r >gran Const, as . ^-'ro^^raT '(^onst. as /. AiP (-p-t 

C:.nstruction Adnun. u<f Program Adinm. of Hru>;iani Candidate ..^perses ■ ^^r 

hx^)ense^s_ Lxpe nso_^-. _ _ Adtni n . Lk^s. La^i^^:^ Admin^. I ncomu Vol umo^_ ^A^l^J^l^J^^ 



l^^;6ALial* '>lii,(m >1U,'>I/^,U()1> 2.9a '>U ,H9lj,U(Jff 2.5/ 1 , 737,00(^ ^ .l/ 

''^7/ Budget: 389,000 iO,-Jb4,000 3.6 12, 396,000 i.I 1,430,000 .27 

*(:andidau- Voltura' fi^^uri's are from I -i : I'i, an t fS publicacion. 

**Kxpense^ per Candidate calcuhiU-d b> divuiin,^ IVst Construct^ion Expupses by Candidate VeLurae. 

SOCKri.: "triS Conf identi.il Pro]ev:t Operating Statement by Pos Categorv/l'ro j^^ct , Period Lading . 
3/31/77," • 66-Dav;t' computer printout. 

Kt-ported by New York Pubiic Interest Croup. ''Statement of factual Correetion and Rebuttai 

[.durational le^.t in^, St-rvite Memorandum i\ Oppo , 1 1 i imi . " Albany, New \ork: NYI^lKC., Ma> 
l->7'>, p, 6, 




profit" ci'-ed by N'^' IM KC ujiore-. 1 I . I n>i i 1 ion 
in Collect-' Board expense for support Services, 
administrative ind other c.xsth, and research and 
dovelopmenl . [70:1] KlS rnu)ha^ized that the 
cost. lor dfveloplJ>K all new tests wert» suh-.t<in- 
till Hid tC't. 'ititLit^r it ni>r lae i-r-JL'tarn -.jn>nsor>- 
loii'd lb .nrh , iifnt iiK r e I'.es . [ 7 1 : 1 U\ 

r^^'Tttv! i-i 1'. ^'vc <'\ i trill lion . 

v<\n\).i'-. .1^.1 1 In-! . lUi' snrplu. o! Sl,l 

!.u 1 ] I'Ui w.i'» ip t '1 "Mkr lu.proveniunl^^ r > ? 1 1 . 
fi I 111 If u^i piij.hi'.L noi. fpiprnt'il. 

in I ((Kiipi ii'U K led vitii tno New V'rk ^Ui- 
prt^nii' (.<Mirt , ihc (olW'.it' Board st.iteJ th. t lo 
r)78-79 the •(^sr of re^t devtlopment t a e"ilrd 
>70,00n [)er lorm. ^He- au^u^ old te-.l '|Uf,l utis 
mmht be exi [ud"d rnm new tosts, it w.!-. i - 
_m.Tfe^t^''t tl^f * o^,t tO tt-a devolopment would 
in, r,<ii*' to 'iiore thm \^Hi,0()(). j : 1 > i Uu^ 
Col .ejie lioard t-.tim<:fed tli.il tiie annunl rrphut^ 
menl t O'St <U t lu> 21 of the SA 1 .urreMll/ 

used In New Yi^rk woalf' nm jj^p r • > - * ") 1 1 o I 
.'i()t),(){)0. i'>i:l-.') . 

\n mitl.il "lippart Report ot the .Vdmis-, i >i\ 
leqting legislation" prep.irci by the New York 



State i.dueatLon Depart nc nl ni Oc Leber J'^/V cited 
t.'.\ample^ of test ,progr<ims with lo^ ^a^iididate 
VfjiiiTHes. Si.nce the dir,closure of secure tests 
would nee.js-;i tatr the crratloo 'M m new Lest 
tor oaeh adml n i s t r 1 1 i on t iit ^osts >m te.st dt.-^^ 
velopment could not h<- imort*zed over a ^-rt up 
of candidates or fWc r a nuinwer ot L»-^t adminis- 
tr.Ulons. Conse juent 1\ , 'thf' 1 o^' l ^ 1 a c i o,n would 
make U dntuult foi -.n.iiier tistln^ u<^iintn'es 
to .-survive. [i32:'^-!;i I tune 19^0, nrwcvtr, p 
f.'iveriior (\irov .ipprovi-d 'senate Hill '<l4J-> 
whid ext npt^ lov-vt^lume lesf^ t r^ya tlie s- 
^ losuri*' reriult eniL'nl s wh u h a' kImu n ;s I c rt d to 
iL'Wer ill in 2,f)00 test sui^j-c^s annually, pro- 
vided> liiU ono fest disc li at KaM c'^ c 

ev<'r \ I nr ^e vt-ar , . j i / . 2 | *■ 

Ai("rdlnK to •'It" f ird 'irviwu r.id 'U-rC otr-ven 
\f ^ \^lu*\y tiie <ulu.iL co^t oi IfV dt^v I-pueiit Is 
<ii^ a iisut t u 1 ent objoVtion to l f u%h- 1 i- tt>s t i n^z 
^lal ton, if it is ^'vuv^a j r(»ni .m "ii.lt il 
Pt rspt't t i ve . " lh.(.v preMiit M it ta' .o.t .a,.u- 
nunt w I 1 1 , stilus 1 de/ sooii and h»' toiw-h d i' 
"sM)v,ibl# second. )rv p' >!)lein." I . 
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Reduced services for handicapped individuals and 
religious minorities. — 

BfcH<juse of 'o^t-» aN->Oi irited witti developing', prw 

tf ^^l forms, tt-Ttin^; >>i i; u' i/ i l i ofls sdy that tti» % 

art' b<jin^ [.»r<tHl t>> oirtail -.^t.^Lai service^ and 

tusC adrni ni r It Ions tor handiLMppud individuals 

and religious mi rior 1 1 J t>s . The i^.j I* e,o Bcvjrd has 

anrvjufict'u that N'ew lork studuias takin;^ la^' \> \ l 

would ne tt^^tfe'd ^}•iL" four timt'^ betwet^n lanuarv 

«ind lune rat he r than tae tu-v^ht ifc^ularlv hud- 

ult'd administ r/,t I on^ I 5 L^^l I S/inilarlv, lUu (,KL 

r 

, was reducfd tron ^ix to, .four administrations, ,ind 
"Uv LSM from four to thrc-e'. [34:^^] BLtor<' thu 
i-mplL'mt'nt<it i>.ni )t the Now Yotk law, the l.ollei.' 
Board reported ciiii handicap+Jud students Le)i'ld 
• tested OM 3lrT|n^t anv day lud at their conven- 
ience; now they will hdvc to take the tests on 
regularly scheJft^Ied dates. Han turd said he ^as 
'distressed about the outback in services, but 
tile new l.tw made fU-Xibif datf-> and special ar- 
ranv;ement s t6r handlcappel test t.ikt>is almost 
Imposs ib le . f 41 : I | 

Ae'_orUi[\^ to the \t,^w York State Lducation 
• -Oeptir tmi'ut ' T "uuti<U [m[)rK t Rt'i-'Ort of the Admis- 
^^rfti lestlnj^ f,'^^'J 1 a t ion /* the American (\)i]t^ge 
Me!; dux f'To^r-ira i/iteaJeJ, Lj ciirairuite rtr^idual 
(f^n-r tmpus) ♦^es^in^', whif'f^ would al teet ai<inv 
adulf^ who ilee^^ tfsr sc uts jTov ola( ement -^athet 
than for admi-..]on. \a \^7H nearly '',^00 stu^ 

tU'o-ts Were t^■•-t^'l in t > i T,nni>er.' Iht- nutnbor of 
V 

■^;>ec'lai non-Sat 'rd >7 t.-s*. daL<»s a\ wouWl h.> 
. re«iiK:ed, iftec r i o;; -0 >,tfKienf,. !132:H) 



1 1 Ua , be^•n e4t i 'n.it ' 



nat ^ lie c <;nre 1 1 it 1 on 



of^ Sunday .ulmi ru t rat i oms <^f tht^^S-M uould affect 
apprc>xia).iter^.^i;»^i«' S..h!)ath oh^^.-rver^^ \n 1980 . 
, 1 nZ; I I ; Spt^Mal' n.ake -up admi n i st ra t i ns of the 
f SAf v;(Mitd pr>)f>)h!v Uv hni nar , afff'itinK jhout 
y-iO to /')!' stiidtnts anauallv. Hec ujj^e of tho 

r 

hl^h cost- or t 'Mivert ln>'' t^sts itUiJ Br.iillp, 
.l.af^^e typr, aisd -and a)~v asset tcs , sfrvi'i-^j for 

rr ? ox.lrT',TU'i V \\)^\ ->ru(^'^ts would he restrUted 
t« a limited ivimber ol it^^t tlrues. j Id^ ll\ 
Sirlw there .ire only Tew ecU'rions. of t'he'sAi 



in ^iMuj^h (Prucbvi do \ptitud Academic a), tne 
^oIl-'„',^ Board did not tcel it could dis^lo-.t 
evtM^ .'nu t >nTi. \s i result, this test has ^ .vn 
withviiMwn frvii;, New \i>rk, .if foe t i lU', ^.oinu stu- 
dent-, ainuail'. . [ i ) J : I i J lliu Ne-w Votk Sl.iI*.- 
idUvJiio'i *. [Mrtncnt's report warned laat tac 
ippirentlv ir.mor v^hangus in test viva i 1 a'^ i i 1 1 \ 
tnuld haVL' -i st.ii'Us impact on the lar^e pL'{niLa- 
lion ^'1 potent I. il candidates. [132*1^1 i.^ r^-- 
:>ort omphci^i/ed tliat tlie reduction ;n -.ptnial 
-services bv tost -.f)on so r>s mij.,ht result in Relax- 
ing a cardidate'» enrt)nment for i se'iK^-^ti'r or 
a yevir, denMU^; credit or advanced standi 'i;: to 
undeTi^radu ite see. iiig admission and pi u^^eiit, 
tn^erburdenin;^ sopie test idmi ni s t rat i on Ltnters 
on a particular t«.^^t viate, and reducin.; spc<::ai 
.service-, for i ite rcvusLrants a[id "wrilk-m" 
('andidat< s . [ 1 iJ • i + j 

Vet advoi .ite-, of t ru t h- : i5- te ^ t j. n^ , sue ii cO- 
ta^vernor ( <>c iai.ir,.ir. Li iL Le-.L.". ' ; " - 
tion need not re-.uJt m ^ui "automatic reductun" 
in the ava 1 I ah 1 ] iCy t'f Lest st>rvi>e- t\j '^^-'^ ^ 
Yorker-i. 136.2] Stevt^i Leifman, nat i<iui l^jl^rec^- 
tor of tiie Coalition v>r Independent ^o|Ie.;» and 
Lniversity Students, claimou thit h\ reducing 
spe«,ial service^ and putting pressure oc« New 
York, the ('ollev;t* Board may be "crvi'^', to sa*i- 
stanCiate their fetirs and problem-, thev see with 
a nat lonai 1 (41 : I J 

Ln fehruar'^ 1980, tne New York St<Jte \ssem7 
bl/ ipproved { bill reC|UirinK, tfie (olU-^e Board 
and other test sponsors to give Sunday exar.ina- 
l u^n^ tor reiit;ious minorities who ',bser\'e tbt 
Sabbatii on Saturday. Iru-re v;as *'ni) neeii" for 
test -.ponsor^ to tike punitive artl-ms .s iin^t 
Orttioiio\ lews .uui Seventh P ly \dverit i ^-^ - , -,aid 
\s^tmbl vp>an SneKb>ti Silver. (o-*!aahat t lO ) s' (>n - 
s(^r ol tbo mea-^ure. j .'O 1 . > j in lum' 1 'Si), ' /jv - \ 
t^riuu Carey s ; ^'ju d Ui^o Jaw Serint*- Hili \ \ 

i-niita "V(_>n;pt > from tt>st di-(io an ro', i^n u nt . I 
It'st loriTIs used tio make-up pu» po >« > md : or J 
w.Uk-ltu h.Mul 1 c apped , ond '^abbath .^tr^'er te.t / 

y 

takers. Another bill i/,ned bv { tiiv r-'ouirc 
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t]>at ^peciaj^dministrat ions of standardized 
tests b'i provided with the same frequency as re^;- 
ular administrations for test takers who are un- 
able to attend on previously scheduled dates be- 
cause of religious observance. [37:2] 



Errors in correcting and reporting test scores. — 

Critics of standardized college admissions tests 
cite the accuracy m correcting and reporting 
test scores as an additional reason for the pas- 
sage of state and federal truth-in-testing leg- 
islation. Despite 'che control measures of test- 
ing companies, clerical and computer errors do 
occur, they maintain. Senator LaVaLle pointed 
out that in 1978 over 360,000 New YurLers were 
administered standardized admissions examinations, 
yet these students had no way of knowing whether 
their tests were accurately marked or of knowing 
what their mistakes were. [151:2] Proponents of 
testing «^gis lat ion believe that test disclosure 
laws will permit students to verify their scores 
and further reduce the risk of computer error. 
[292:2] 

In testimony before LaValle*s Higher Educa- 
tion committee, Julia Stromsted, legislative di- 
rector of the Independent Student Coalition, re- 
ported that errors in scoring and reporting test 
scores may adversely affect thousands of test 
takers annually. Stromsted cited ETS's identifi- 
cation of "unacknowledged repeaters" on the LSAT, 
in which, several years ago, students were asked 
on the LSAT application form if they had taken 
the test before. This question was used to give 
students the opportu.ilty to acknowledge that they 
were repeating the test. A check bv ETS, using 
Its records on prior candidates, however, identi- 
fied repeaters who did not answer the question or 
who gave- false answers. The test scores of these 
students sent to colleges and universities carried 
the designation of "unacknowledged repeater." 
According to Stromsted, a computer error in 



ERIC 



1975-76 accidentally identified thousands Oi. 
test candidates as "unacknowledged repeaters." 
ETS toj.d law schools to disregard the designa- 
tion, but did not correct the error or inform 
the test applicants, Stromsted claimed. Another 
computer error, which affected more than 50,000 
candidates, occurred during the 1977 administra- 
tion of the (Graduate Manigement Admission Test. 
Incorrect scores w^ire sent to hundreds of grad- 
uate schools nationwide. Wliile the error was 
small, ETS admitted that it could have affected 
students applying to schools with cutoff scores, 
St|omsted stated. [153:62] 

Prior to the enactment of testing legisla- 
tion, it was estimated that less than one-tenth 
of one percent of the 1.5 million SAT takers 
nationwide make a request to have their scores 
verified. Of the 1,000 to 1,600 test scores 
that are reviewed, about 40 are changed, accord- 
ing to Jerry Murphy, director of corporate qual- 
ity assurance and data policy administration at 
ETS. According to one education writer, this 
represents an "error rate" of .0027 of one 
percent. [293:20] 

In testimony befort the Maryland Constitu- 
tional and Adirinistrative Law Committee, Alice 
Irby of ETS, testified that verificrtion of 
jcores IS possible through present procedures. 
Answer sheets that are pulled for extensive 
quality control checks b> hand rather than by 
machine indicate that the accuracy rate is very 
high . However, if any persons have reason to 
believe that an error has been made on thetr 
test score, they may request rescoring by hand. 
Irby noted that the Law School Council has had 
this service for several years, but tew students 
use it. [133:4] 

To further insure that test answer shaets 
are correctly scored, the College Board announced 
in April 1980 that it would allow the 1.5 million 
juniors and seniors who took the SAT to buy hack 
tlicir answer sheets and the scaring key, but not 
the test questions, for a nominal fee of about 
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?4.00. In Nuw \ork St-itf, [.owcver, students cdn 
also buy back tho test questions, ds well as the 
answers, for $4.65. [268:A5J Ihe College Board 
announced that it Look this action "to meet con- 
sumer concerns over testing, without compromising 
test quality or eclucaiional values." [96:8] 1 ur- 
therraorc!, the O.lLege Board said it plans to pub- 
lish an actual SAT used during the previous jca- 
demic year for students and researchers to examine, 
along with information about scoring, standard 
error of measurement » and each question's 
difficulty. [268:A5 | 

Similarly, after the 1980 fall administra- 
tion of the PSAT nationwide, ,)ne million juniors 
will get back the test questions and answers at 
no additional charge. Currently the PSAT costs 
$3.25 and is a .'etired form of the SAT. i268:A3j 
Hanfcrd said that tliese measures were intended 
to carry out part of the public interest princi- 
ples that test sponsors and test organizations 
agreed to last December. [96:8] He said the fo- 
cus of the new Information would be on the PSAT 
"because it is an early guidance tool." [96:8] 

As of September 1980, it had been estimated 
that 4.8 percent of the 118,000 SAT takers in 
Nev^r YoLk hid requested copieo of the questions 
and correct answers along with their own answers; 
this compares to about 17 percent of those taking 
the LSAT. [38:250; 94.. :1] 

Pro-testing legislation grotps believe that 
the College Board's decision to return test ques- 
tions and answers to test takers is merely an at- 
ten.pt to halt the enactment of furtlier test dis- 
closure legislation. According to the National 
Education /association, giving students a way to 
get bark their SAT answer sheets is a small con- 
cession. NEA President WilLard McOuire said it 
was "only the 'tip of the iceberg' in problems 
intrinsic to the testing process." McCuire 
ur-;ed the adoption of t ruth- 1 n~ test ing h^gisla- 
tlon at the state and federal level. [270:2] 



Equating tho tests. — in the initial stages of 
the debate between ,iro- and anti-Le^.tnm forces, 
Lhtjj Issue of equatiPL; the tests wis hi.^'hlv con- 
troversial. [15J.hOj After imuh debate, tiie 
\ew York legislature specifiLailv e->empted (juer,- 
lion^ used in equating tests from tla test dis- 
closure nrovibions. Current! V, onl\ tnuse ques- 
tion, used te calculate the student's raw score, 
winch deter.mnes his or ner grade, must be dis- 
closed. [209:1 ] 

L rs stated that the equating pr ^. ess is <i 
highly specialized field not even fully under- 
stood by many psycliome t ric lans . [h7:lj ilie 
metnod of equating the SA'l involves inserting 
a section of questions that have been used pre- 
viously- in one or more new forms of tlie test, 
with each SAl composed of approximately 20 per- 
cent equating questions. [ 76 : 2 ] This process 
-enables test makers to "tie' Afferent forms of 
the SAT to a standard score scaie and it is de- 
signed to insure that a student's score of 550 
IS equivalent to another student's score of 550, 
throughout the nation and over time. [53:1; 
176:2] Although New York State exempted test 
questions used to equate tests from the disclo- 
sure provision, KIS indicated that other state 
legislatures might not make this exemption, 
thereby jeopardizing the quality of the tests. 
[LiJ:3] 

Disclosure of background and statistical data. — 

New York's t ruth-in-test ing law currently re- 
quires test companies to make public after Janu- 
arv 1, 1980, all background reports and st.itis- 
tical datci pertaining to tests. [264:2] Advo- 
cates of truth-i n-test ing argue that tliis pro- 
vision is necessary if scholars, consumers, and 
educators are to adeciuaLely .issess test (Miarae- 
teristics. NYPIRC lias claimed that h'l S is with- 
holding severcil reports. The rei>orts under 
dispute are Test Analyses," which is needed to 
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vurif^ the validit\ of CIS*'> i*(jUcir^i>^ procudures; 
<i Tia]nr mtern.il btudv» "Cultural lU is in lestm^: 
Challeaf;e and Response'"; and a study on l\w u.:>o uf 
the LSA'I by law sebools. \20^:h] 

FTS» on the other hand, claims that the dis- 
closure of background leport^, statistical data, 
and validity studies developed bv -Jnd for individ- 
ual colleges and institutions is overly b'-oad in 
scope. Studies performed under contract for cli- 
ent organizations such as the Law Sctu)oi Admis- 
sions Council and the federal government are the 
property of thos*^ ent 1 1 ies , and these studies 
may contain confidential information which LTS 
does not have the authority to release. Further- 
more, much of ETS's statistical data are associ- 
ated with its t^.sts and designed for internal 
use. fl7f^:3l On a practical level, the College 
Board reported that the release of all background 
reports aad statistical data would inuP^Jate the 
Commissioner of Education's office with file cab- 
'nets of SAT data alone, not to mention computer 
printouts of tesc item analyses; mathematical 
equations used in scaling and equating tests; 
and reports concerning the operation of hundreds 
of test centers, all at an additional cost to 
the test sponsor. Strict compliance would be 
"extraordinarily burdensome" and of question- 
able benefit to anyone, acconUng to the Col- 
lege Board. [33:2] The disclosure of background 
and statistical data would affect primarily the 
validity studies provided to institutions which 
help colleges refine their admission procedures. 
Rather than being placed in a possible legal con- 
frontation bttween the law and the institution's 
rights, many test sponsors indicated that they 
would stop providing validity studies. The loss 
of validity drita, in turn, would hinder the se- 
lection process and affect the applicants, con- 
cluded a report by the New York State I'ducatinn 
Department . [1 5^:15] 
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Extraterritorial apollcation. — Several different 

provisions of che New \ork standardized testing 
law have evoked questions of I n t iTp r* t a 1 1 on . 
une of those cj nest ions involves the issue ot 
extraterritorial application of New YorlN^H law. 
According to Arnold liloom. New York state educa- 
tion department public intormation director, the 
department considers all students applying to 
institutions in the state to be covered b\ the 
law. [233:3] As the law vvas originally written, 
<iny eut-uf-the-state studt^nt a[)pl>ing to an in- 
stitution in New York could receive his or her 
test. [294:13/] Strict adherence to this inter- 
pretation would mean that the College Board 
would eventually have to reveal all of the test 
forms it currently uses nationwide. 

In response to this interpretation, the Col- 
lege Board filed a complaint in November 1979, 
asking the New York Supreme Court to 'eclare 
the law inapplicable to extraterritorial tests. 
[32:1] Th- College Board asserted that extra- 
territorial application of the law violates its 
due process rights under the Fourteenth Amend- 
ment and tiiat it conflicts with both laws in 
other states and with laws which protect the 
College Board*s property interests in the tests. 
[59:11-12; 52:1] 

Application of the law to rests administered 
outside New York, the suit stated, would seri- 
ously affect the College BoardVs testing programs 
and services. Specifically, this interf re tat ion 
would require them to do the following: (1) dis- 
close virtually all SAT -uestions, including 
questionri used solely in tests administered out- 
side of New York; (2) discontinue the practice 
of providing the score reports of ,seniors in 
Connecticut, Indiana, and Pennsylvania to their 
stateLs scholarship program, unless the student 
indicated otherwise; and (3) file confidential 
reports that thr» CFLB prepares for high sciiools, 
colleges, universities, and seholrirship sponsors 
located outside New York. [39:12-13] Hanford 
commentt'd that "notinng in the language of the 

(\ I 



law indicates that it was intended to apply Lo 
tests given outside of New York." [52:1] 

In June 1980, Governor Carey approved the 
senate bill which amended the education law m 
relation to standardized testing. He said the 
bill would clarify truth-in-testing provisions 
and would limit thfc law's application to tests 
administered in New York State. [37:1-2] 

Nationwide Movement Predicted 

Since the enactment of New York's truth-in- 
test inr law in January 1980, nearly 20 states 
have introduced bills to regulate standardized 
admissions tests for college or professional 
school. This widespread legislative attention 
is evidence of an emerging trend. [236:189] 
Steve Solomon, coordinator for NYPIRG's campaign 
for testing legislation said, "the fact that so 
many states are considering legislation indicates 
many students and parents are concerned about the 
lack of information." [181:1] Currently, only 
New York and Califcrnia have enacted laws success- 
fully, but it is estimated that nine other bills 
have a chance of survival. [29:1, 25] Highlights 
of proposed state legislation mandating the dis- 
closure of tests and test related information 
follow. 

California: S.B. 2005, signed into law 
September 1978 and effective in 1979, was the 
nation's first law requiring test publishers to 
disclose information to test takers. This law 
applies to any standardized test used for post- 
secondary admissions tests given to more than 
3,000 students annually. Tests designed for 
placement, guidance counseling, research, and 
meeting secondary school graduation requirements 
are exempt* Test agencies are required to file 
with the Comnissioner of Postsecondary Education 
a representative sample of test questions and 
answers equivalent to those used on secure tests. 
Test sponsors must also disclose the total amount 
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of tees received ind the expenses <it t ributable 
to the test. S.B, 2005 is a limited disclosure 
law since test takers are provided with informa- 
tion about the tests and their use^ but not with 
test questions and answers. [34:18; 49:2] The 
California legislature is currently considering 
an araendment which would provide test takers 
with a statutory cause of action against any 
testing agency for unnecessary delays in report- 
ing scores or for the loss of scores. [236:188] 

Colorado: S.B. 320, like thp California law, 
applies to standardized tests used for postsecond- 
ary admissions administered to more than 3,000 
students annually. It is not a full disclosure 
bill either, and only background and explanatory 
material must be disclosed to test takers. Tests 
used for placement, guidance counselingT^^search, 
and meeting secondary school graduation require- 
ments are exempt from the legislation. Introduced 
in January 1979, the Senate Committee on Education 
postponed it indefinitely. [34:19; 49:2] 

Florida : H.B. 1169 applies to any standard- 
ized test used for postsecondary admissioVis , as 
^ell as for financial aid for placement. This 
bill requires full disclosure of test questions 
and answers and other test information to test 
takers. Civil service and job placement tests 
are excluded. Introduced in early 1979, the 
bill's author withdrew it to amend its original 
provisions. [34:20; 49:2] 

I ndiana : S.B. 102 is aimed at postsecond- 
ary students. Testing companies are recmired 
to report test answers, scoring procedures, po- 
tential use of test scores , and other informa- 
tion to both postsecondary education institutions 
and to students. Violators may be fined up to 
$500. [257:2; 281:194] 

Maryland : H.B. 14?5 is a limited disclosure 
bill that applies to any standardized test used 
for postsecondary admissions or placement. Test 
takers were to receive e^planatory material, in- 
formation regarding cutoff scores and mc'iterial 
contrasting score use and weight with grades. 
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Although this bill did not pass, the Maryland 
House of Delegates is considering other measures 
which have been introduced recently. [3^:21; 
49:2; 133:1| 

Massachusetts : S. 237 applies to all com- 
mercially available standardized achievement or 
aptitude tests administered in ^^^ides K-12. 
Within 60 days after a school receives test re- 
sults, parents, students, or both will be per- 
mitted to review the corre«"tcd responses to tests, 
but they are not allowed to remove tne test items 
or answers f^sm the school premises. S. 238 fo- 
cuses on postsecondary and professional school 
admissions. It requires test companies to sub- 
mit to the chancellor information on questions 
used in calculating raw scores, a copy of the 
answers, and the scoring rules. S. 264 calls 
for a special commission to undertake an investi- 
gative study of the CEEB, Its administration, the 
accuracy of its testing program, and its role in 
the admissions process. [257:1; 281:194] Massa- 
chusetts also requires the disclosure of it . com- 
petency tests. [33:7] 

New Jersey : S.B. 3461 applies to any test 
developed for the purpose of selection, placement, 
classification, graduation, or any other reason 
concerning elementary, secondary, postsecondary, 
or professional school. This bill calls for the 
release ot^ test questions, answers, and scor- 
ing rules within 30 days after the test results 
are released. The measure prohibits a test com- 
pany from charging for the disclosure service, 
and test scores cannot be forwarded to institu- 
tions without the test takers* consent. [34:24; 
257:2] 

Ohio: H.B. 636 is modeled after the New 
Yt rk law. It is a full disclosure measure that 
applies to any standardized test for postsecond- 
ary admissions selection. Test agencies must 
fulfill requests for test questions and answers, 
answer sheet, and r iw score. At the time of 
registration, the agencies must provide the test 
taker with Information <ibout the purposes of the 



test, subject matter, ^ now U'd^iu and slviLis being 
measured, explanation of the score scale and 
standard error, correlations between test scores 
and grade, how the scores will be reported, and 
who owns the scores. Introduced in May 1979, 
the measure has been assigned to a subommittee 
for furth2r debate. [34:22; 49:2J 

Pennsylvania : S.B. 994 is also modeled 
after the New York law. It was referred to the 
Senate Education Committee on October 2, 1979. 
Legislation applies to any examinati'^n used for 
admission to undergraduate, graduate, or proj.*es- 
sional school. All questions used to calculate 
the raw score and the answer sheet are to be re- 
leased to test takers upon request, but test 
items essential for field trials and comparabil- 
ity are exempt. Test agencies must also divulge 
reports and data prepared for individual insti- 
tutions. [34:23; 49:2] 

South Carolina : A recently introduced meas- 
ure would require test companies to ti^e post- 
secondary test questions, answers and other ^*n- 
formation with the state education department. 
[281:194; 257:2] 

Tennessee : H.B. 1460, the Standardized * 
Testing Act of 1"*8Q, covers postsecondary ad- 
mission tests. It allows test takers to find 
out what questions they answered correctly. 
The College Board Achievement Tests and the GRE 
Advanced Tests are exempt, |257:2] 

Texa s : H.B, 59 applies to any examination 
used to select candidates for admission to under- 
graduate, graduate, or professional school. This 
bill requires test agencies to provide all test 
takers with test questions and answers, whether 
or not they request them. Also, upor written 
request, all information contained in the test- 
ing agencies* records about the test taker must 
be disclosed. This full disclosure measure was 
postponed in 1979 by the House Committee on 
Higher Education. [34:23; 49:2] 

Similar legislation has been introduced, 
postponed, or defeated in Rhode Island, Michigan, 
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Louisiana, Connecticut, Illinois, Minnesota, Miss- 
issippi, Missouri, and Oklahoiru- 1^)3:7; 29:1, 25) 

In their publica t iotv*5>j:2V^i 'n^y for tn^. 
Truth about ''Truth in Testiruj'' Ujirlatian, Rex- 
ford Brown and Merle Steven McClung observed 
that most testing measures apply to pos tsecondary 
admissions testing and require full or partial 
disclosure test questions and answers sfiortb 
after the test-, are administered. [34: ix] Test 
legislation laws typically exclude civil service 
examinations, tests for research and guidance 
counseling, secondary school graduation require- 
ments. College Board Achievement Tests, and GRE 
Advanced Tests. (34:17-24) Brown and McClung 
reported that most state proposals entrust en- 
forcement of the laws to the state's postsecond- 
ary education agencies, such as the Pennsylvania 
Department of Education, Ohio Board of Regents, 
California Postsecondary Education Commission, 
and Maryland Board for Higher Education. The 
different characters and responsibilities of 
these agencies. Brown and McClung maintained, 
"suggest a potential for state to state miscom- 
munication and confusion if more laws are 
enacted." [34:15] Similarly, Dario Robertson, 
writing in the Journal of Led) and Fducation 
(April 1980) noted that if the current state 
legislative trend continues, disparate truth-in- 
testing laws may seriously burden the testing 
agencies* attempts at compliance. [236:193] 

ETS has urged states to postpone the enact- 
ment of laws that regulate admissions testing in 
order to assess the New York experience, partic- 
ularly the economic impact and the estimated im- 
provement due to unlimited test disclosure; to 
await legal rulings rlnce some of New York*s 
test disclosure provisions are being challenged 
on constitutional grounds; and to consider inde- 
pendent studies by the American Coun( i I on Kduca- 
tion, the Ford Foundation, and the National 
Academy of Sciences. [71:2] 

'the American Council on Education helped 
found ETS In 194 7. The president of ACE s erven 
^^^fi<^^o on the ETS Board ot Trust-es. 



In March 1980, m testimonv before the Mary- 
Ja-id House of Delegates Constitutional and Admin- 
istrative Law Committee, Alice Irby stressed that 
llw regulation of admissions testing wa^ premature 
She stated that testing legislation is ' unneces- 
sary and that the objectives of those who want 
test agencies to provide more information to stu- 
dents about their scores and about the tests them- 
selves are being accomplished through negotiation, 
re-examination, and deliberation without imposing 
the long arm of the staf.." U33:5] 

Federal Truth-fn-Testing Legislation 

Congressional legislation over the merits of 
truth-in-testing has been under consideration 
since 1977. The first federal truth-in-testing 
bill, although unsuccessfully introduced in the 
House on April 29, 1977, formed the basis for 
current proposals. [236:190] In 1979 two addi- 
tional federal bills were introduced, the Gibbons 
Bill (H.R. 3564) and the Weiss Bill (H.R. 4949). 
[33:7] The Gibbons Bill, introduced on April 
10, 1979, applied to all standardized admissions 
testing, including aptitude and achievement 
tests, state licensing examinations for doctors, 
lawyers, plumbers, and cosmetologists, and civil 
se-vice examinations. [34:16; 275:2] Sam Oibbons 
(R-N.Y.) said that his measure was needed to 
"strengthen consumer rights." Provisions of the 
bill called for the release of information about 
test content and scoring, and the prohibition of 
post-examination test score curving. [98:11] 
The bill also required test publishers to reveal 
the required "cut off" sdorca for higher educa- 
tion institutions. It was not, however, a full 
di .( iosure measure since it did not provide for 
the reltMse of test questions and answers to tlie 
public, r clid it require test companies to 
file an ling with a federal agency. This proposal 
received little attentl{)n. [34:1b] 

Commenting on the (;ibbons Bill, hred Hargadm, 
chairman of the College Board, stated that it nad 
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no control over the people who use test bcore^ 
and that it did not even recommend cutoff 
scores. He said that the Gibbons measure de- 
fined the idea of "test" too broadly and that 
there was nu reason for government regulation 
of occupational testing. [275:2] 

A second federal truth-in-testing bill was 
introduced by Representative Ted Weiss (D-N.Y.) 
on July 24, 1979. Known as the "Educational 
Testing Act of 1979/' the measure was cosponsored 
by Representatives Shirley Chisholm (D-N.Y.) and 
George Miller (D-Cal,). Referring to the bill as 
an extension of legislation enacted in California 
and New York, Congressman Weiss said that . . . 
the bill "is designed to alleviate bias iniierent 
in the tests, to improve public accountability 
and to mandate financial disclosure." [292:2] 

Like its New York counterpart, H.R. 4949 
applies to any standardized test used in the post- 
secondary admissions process and to organizations 
that develop, sponsor or administer such tests. 
It does not apply to tests developed and adminis- 
tered by colleges fo^- their own purposes. [49:1] 
The bill states that after the tc-t has been filed 
with the commissioner of education, and upon re- 
quest of the test subject, any test taker may ob- 
tain, for a nominal fee (I) a copy of the test 
questions used irj determining the raw score, (2) 
the individual answer sheet together with a copy 
of the correct answer Siieets, and (3) a statement 
of the raw score used to calculate the scores al- 
ready sent to the test subject. [287:8] 

Under ti.e Weiss bill, test agencies are to 
report complete testing costs and fees to the 
commissioner, including the total number of times 
a test was taken during the testing year; the nun:- 
her of test subjects who took the test once, twice, 
and more than twice; the total amount of fees re- 
ce Ived f rom the test sub ject s ; the total amount of 
revenue received from eacli test program; and the 
expenses Incurred by the test agency for each test 
program, test developmei.t , .md all overhead 
expenses. (287:10-11) 

ERLC 



Within one year after the bill's enactment, 
the commissioner is co report to Congress tlie 
relationship between test scores and income, 
race, sex, etnnic status, and handicapped status; 
and the relat ionship between test scores and 
the completion of test preparation courses, 
1287:7j 

Representative Weiss said that his bill did 
not dictate what questions can or cannot be asked 
on a test nor did it "try to alter the admissions 
criteria developed by colleges, graduate and pro- 
fessional schools." [98:11] in testimony before 
the House Subcommittee on Elementary and Second- 
ary Education, Paul Pcttinger, director of the 
National Center for the Study of Professions, 
cautioned m t to let "clever and professional 
marketing experts. . . confuse and impress" 
legislators with technicalities and test develop- 
ment costs. [24:2] Also in testimony before the 
House Subcommittee on Elementary and Secondary 
Education, Althea Simmons, diiector of the Wash- 
ington Bureau of the NAACP, testified that 
truth-in- testing legislation was an idea whose 
time had come. The NAACP was aware that test 
scores were supplemented by other admissions 
criteria Simmons said, but College Board scores 
were still "the deciding factor regarding Who 
gets admitted to what Ins t itu t ^.on . " [256:7] 
[emphasis in the original] Simmons stated that 
the NAACP did not oppose use of tests per se, 
but they did call upon the testing industry to 
develop standardized tests which have been cor- 
rected for possible cultural bias and which 
properly measure the amount of knowledge retained 
by students regardless of their background. 
[259:8] Release of lest questions and answers 
as seen as an overstated concern. [256:8] "The 
intent of testing," Simmons concluded, "should 
he to open up avenues for student*^." [256:11] 

lest agencies such as EfS and AC'I have 
vigorously opposed hotli the (.Ibbons and Weiss 
truth- in- testing bills. Test agencies said 
that chese bills would create a cumbersome and 
/ \ 



93 



unnecessary bureaucracy. Fred Hargadon, chair- 
man of the Colxege Board, urged Congress to let 
the testing legislation "ferment" until everyone 
could learn from the test disclosure experience 
in New York. Hargadon cautioned against federal 
legislation saying it would result in "regula- 
tion of college admissions testing programs, 
jus. one step removed from federal regulation 
of college admissions themselves." [98:11] 
Clark Cahow, assistant provost at Duke University, 
said that "federal intervention in the matters of 
standardized testing when there is no perceived 
crisis will not change the way schools admit stu- 
dents." [54:2] According to John T. Casteen III, 
dean of admissions at the University of Virginia, 
federal legislation would fall short of reforming 
education because it would sacrifice "the effec- 
tiveness of the existing tests as measures of 
where we are and where we need to go." [54:2] 
Commenting on criticism leveled at the New York 
law, Albert Shankei , president of the American 
Federation of Teachers, called federal legisla- 
tion "dangerously premature." Shanker expressed 
concern about preserving the quality of the tests, 
maintaining standards, and the drastically al- 
tered role of the federal government in education 
which would result f rom the passage of truth— in— 
testing legislation. [54:1] Former U.S. Commis- 
sioner of Education and president-elect of the 
Carnegie Fou.idation for the Advancen^nt of Teach- 
ing, Ernest Boyer, rejected the idea that Con- 
gress needed "to r?mper with testing." Boyer 
called upon colleges and schools to cooperate 
more closely to improve the quality of both tests 
and schools. Boyer stated that the truth-in- 
testing campaign was diverting the nation from 
the real issue, quality in education. [30:3J 

An August 1979 editorial in the WarMntjion 
Post stated that the Weiss bill attempted to 
establish broad federal supervision o^'er all ad- 
missions testing and helped lay the "foundation 
for a regulatory system." The editorial com- 
mented that test scores *ire not the only 



criterion for college admissions and tiiat theie 
(vas no reason to diminish Lheir usefulness and 
force institutions to rely un more rubjective 
criteria, not necessarily to the advantage of 
"the youngster who does not fit the usual pat- 
tern." Furthermore, since oversight of the tests 
would reside in the Department of Education, 
where the NEA has strong political influence, the 
inplications of the law exceeded the bill's in- 
tended purposes, the editorial concluded. 
[248:A26] 

After what was tCLmed a "hysterical lobby- 
ing effort" on the part of the testing organiza- 
tions, the Weiss bill was withdrawn. [^1S:A4] 
An aide to Congressman Weiss said that, rather 
than have the measure pruned of its salient 
features, further action would be postponed un- 
til 1980 when more congressional support couU 
be gathered. [4:6J Don Cameron, assistant exec- 
utive director of the NEA said that "the testing 
industry exerted all the influence it has to 
kill this legislation because they don't want to 
reveal what this legislation would make them re- 
veal." [215:A4] 

Rexford Brown and Merle McClung pointed out 
that if truth-in-testing legislation survives in 
its present form, litigation may expand to in- 
clude other forms cf testing, and test takers 
who challenge the validity of a test or who al- 
lege misuse of a particular test may also initi- 
ate litigation* Therefore, until the legal 
parameters are firmly established, they suggested 
that some states may wish to reconsider implement- 
ing truth-in-testing legislation. [34:41-42] 

Public Interest Principles 

Representatives of five national testing 
programs established a set of "Public Interest 
Principles" in January 1980. Leaders of the 
College Board, Graduate Record Examinations 
Board, Graduate Management Admission Council, 
Law School Admission Council, and Educational 
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Testing Service stated thai public interest 
principles would guide future developments 
in their standardized admissions examinations. 
[72:1] 

These principles call for increased publi- 
cation of test content, publically visible meth- 
ods for eliminating cest bias, procedures for 
test takers to have their scores verified, and 
ways to j ncrease che appropriate use of scores 
and CO discourage their misuse. However, because 
individual testing programs differ according to 
the purpose of the institutions using them, 
changes will be developed separately by each or- 
ganization. [7'':1] One of the purposes of the 
guidelii^es, asserted Hanford, was "to gat on rec- 
ord in advance of a number of legislative initi- 
atives outside New York that we are taking seri- 
ously the expressions of public concern and 
intend to do something about it voluntarily." 
[108:11] "The point is," Turnbull added, "that 
we are listening to the comments people are mak- 
ing about the need for more public information." 
[294:137] Senator LaValle noted that the test 
sponsor's guidelines indicated "a willi ngness 
on the part of the testing agencies to comply 
with the law." [108:11] 

The text of the "Public Interest Principles 
Cot the De;3ign and Use of Admissions Testing 
Programs" follow: 

1. We recognize the legitimate interest 
of the public in knowing what the 
test« contain and their efficacy in 
performing their intended functions. 
Therefore, we will implement the 
principle of publication of lest 
content to a degree limited only by 
reasonable safeguards of efficiency, 
co^t, quality, and the educational 
impact of the programs. 

2. We fully support the principle of 
equity and we will continue to main-- 
tain and strengthen credible proce- 
dures for detecting bias and elimi- 
nating it from the content of the 
teats, while making such procedures 
visible tc> the public. 

3. We recognize the need fctr outine pro- 
cedures that allow the test taker to 



arrange for vcrificaMon of trie ac- 
V curacy of the procedures determining 
the score attributed to him or her. 

4. We believe that tests ^' s)uld be 
readily available to a. I inaividuals, 
regardless of conditio -"^ such as 
physical handicap or religious be- 
liefs that may prevent the taking of 
exams under circumstances that meet 
the convenience of the majority. 

5 . We recognize that tests, toge ther 
with the procedures for scoring them 
and reporting the results, should be 
designed to provide test takers with 
as much useful information as may be 
feasible about the specifics of their 
performance on the tests. 

^. We reaffirm the right of individuals 
and institutions to privacy with re- 
gard to information by and about 
them, which should be safeguarded 
from unauthorized disclosure. 

7. We recognize the need to formulate, 
maintain, a. id publish widely prin- 
ciples of appropriate use of scores 
and other test information derived 
from testing programs and to be 
alert to and actively discourage 
misuse . 

8. We recognize that both the institu- 
tions making use of test scores and 
the test takers themselves should 
have mechanisms through which to ex- 
press thair legitimate interests 
concerning the design and operation 
of testing programs and the use of 
the information derived from them. 
[73:1] 

See ^ppendix K on page 147 for the com- 
plete "Operational Elements" of the Public In- 
terest Principles in which test sponsors present 
their diverse approaches to opening communica- 
tions concerning important issues in testing. 

Wliile sponsors of the GM/\T, LSAT, and GKE 
have stated tb ^y plan to make disclosure their 
national policy, other test sponsors have Indi- 
cated that they will continue to oppose truth- 
in-testing legislation. [108:11 ] Han ford 
stated that the steps outlined in tiie "Puolic 

Interest Principles" shov'a not be interpreted 

if 

as a change in the Co3 lege board's opposition 
to truth-i*»-test ing, which he characterized as 



"educationally unsound" and a "threat to the va- 
Ifdity and fairness of admissions testing," 
Similarly, in a letter to the editors of the iJcQ 
York Times, Turnbull said that ETS cont,inued to 
oppose testing legislation in New York and else- 
where because the disclosure of every edition of 
evefry admissions test has "the effect of curtail- 
ing the nuniber of tests that can be administered, 
raising the, costTs to students, and thrtatening 
test quality." Turnbull asserted that the "Pub- 
lic' Interest 'Principles" cal^ for increased pub- 
lication of information about tests that goes 
"beyond any law in these matteis." [282:1] 

According to one educational newspaper, 
however, the only real concession contained in 
the "Public Interest Principles" was that groups 
of test sponsors and test makers would probably 
announce when the results from one of their tests 
would be available. [294:137] 

Summary of the 
Tru*h-in-Testing Controversy 

Test sponsors, agencies, and their support- 
ers assert that truth-in-testing legislation 
measures are not consumer bills but actually 
consumer fraud. [71:2; 231:190] The New York 
State legislation, thev believe, has signaled 
Che beginning of government T-»gulation over "he 
admissions testing process, although no need 
for such legislation has been demonstrated. 
Many testing organizations find themselves in 
agreement with those who \elieve that test 
takers and the Public need a better understand- 
ing of the uses and limitations of tests, (/l: 
2-3] But they strongly oppose legislation which 
mandates the disclosure of every edition of 
every test. The total diprlosure provision 
threatens test quality, increases costs to stu- 
dents, and reduces accessibility to testing pro- 
grams by handicapped citizens, Sabbarh observers, 
military personnel, and walk-in applicants, 
65:2] 



In addition, test agencies emphasize that 
most f^Formation required by test legislation 
regarding test content scoring, score reporting, 
and interpretation is currently being provided 
or will be implemented soon. [133:4] The Col- 
lege Board reported that its routine policies 
and practices voluntarily meet nkiny of the truth- 
in-testing requirements. CEEB reiterated that 
it provides a complete practice SAT to all teat 
takers, the correct answers , "Scoring instruc- 
tions, a review of the types of questions, and 
test-taking strategies before . they .take the 
test. Additionally, tne College Board distriu- 
utes, to educational institutions ^nd students 
registering for the SAT, "Guidelines on the -^es 
of College Board Test Scores and Related Data," 
which addresses many concerns such as the na- 
ture, purpose, and use of the test. [53:2] 

Test sponsors and agencies are urging the 
postponement of an> additional laws to regulate 
admissions testing until the New York experi- 
ence hac been evaluated, legal rulings have been 
r*eached, and independent studies completed. 
[71:2] ETS believes that it is counterproduc- 
tive to attack standards at a time when the 
public is calling for quality education, and 
further, that the anti-testing movement is not 
supported by the majority of Americans. [71:2] 
"If the motivations behind test disclosure 
legislation are sooner or later to put an end 
to admissions tests altogether," staCed George 
H. Hanford, president of the College Board, 
"then the admissions process will become more 
and more capricious/' [51:4] 

Proponents of truth-in-testing, on the 
other hand, have argued that standardized tests 

re a key factor in getting into college and 
professional school. [36:1] Truth-in-testing 
legislation, they assert, will open the test- 
ing process to increased understanding by the 
public of the purposes and limitations of tests. 
[130:5] Supporters of testing legislation 
.state that they are not seeking the elimination 
of standardized testing but rather encouraging 
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its responsible use. [149:2] They naintain that 
truth-m-test ing legislation- J.s not going to put 
tpst makers out of business, reduce their corpo- 
rate profitability, or do away with college ad- 
missions tests. [226:2] Furthermore, since test 
\ legislation advocates contend that the cost of 

test development is quite bmall, Jisclosure pro- 
visions should not hamper the development cTf 
nevt tests nor increase signif ica^ntly the fees 
for test taking. [292.3] They rlso view testing 
legislation as promoting competition among test 
agencies and assuring a degree of quality con- 
trol through public review. [236:199] As more 
states follow th^ example of New York, and fed- 
eral legislation makes its way through Congress^ 
advocates of t ruth-in-test^ng maintain that the 
mantle ^pf secrecy wfilch surrounds the testing 
Indus t):y will be broken, and light shed on them 
for the first H:lme. [153:64] . ^ 

In June l^^O, York Governor Hugh Carey 
said- that most of the legal and administrative 



ditf iculties; stemming from the enactment of the 
standardized testing legislation had been rem- 
edied by amendments to the law. ^ Carey reported 
that the testing law had not resulted in the ad- 
verse con«^equences predicted. Overall » there 
had been no dramatic escalation in the cost of 
such tests nor a massive reduction in their 
availabi*liev to New Yorkers. [37:1] 

RexfordT Brown and Merle McClung pointed 
c:ut that the testimony of proponents and oppo- 
nents of truth-in-testing legislation abounds 
wit^ assertions but little substantial evidence. 
The lack of hard data and strong emotions evoked 
by the debates, they maintain, are signs of 
deeper, undeclared issues wnich have troubled 
the nation for generations: meritocracy, elit- 
ism, and equal opportunity. [34:49] The follow- 
ing exh^.bits prepared by Brown and McClung and 
reproduced in Table 18 summarize both the pro- 
and anti-testing stances regarding truth-in- 
testing legislation, [34:xi-xiiil 



TABLj: 18.7-The Debate Over Testing Legislation: Pros apd Cons 



I* Debate About Role and Power of Testing Companies 



• Antl-T^3t ing ^ Sent imen t s . 

Te^ts havq prpfound inf luence ^pon American 
lives and life thances. 



Testing companies are unaccountable to cheir 
dependent public — particularly true of the* 
Educational Testing Service (£TS) an. Ameri- 
can College Testing (ACT). 



Testing companies are too secretive; te8,t 
takers do not Jcnow a^out tests; researchers 
cannot study them. 

Massive testiug does more >iarm than good 
(e- ^ consumes time bett-er spent learning, 
aiders curriculum, stigmatizes children, ^ 
misleads public, etc.) 



Tests are inherently biased against plurali.^m, 
tend to further stratify society. 




Tests are widely misused and misunderstood. 



Pro-Testing Sentiments 

Tests have little influence compated to fam- 
ily, social and educational influence^ grade 
point average. 

Commercia\ test publisher's are accountable to 
market forces; test makers, including ET& and \. 
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ACT, are accountable to professional stand-- 
ards, education comraunity, higher education ^ 
communities, coHrts, client groups, trustees, 
and Ititernal Revenue Service. ^- 

Critics confuse security — a technical issue — 
with secrecy; ample test information is 
availabj.e both to test takers and qualified 
researchers. 

The public and higher education hav( asked 
for massive testing; testing produces infor- ' 
mation useful for improving education; it 
does more good than harm takes little 

time, diagnoses problems, helps administra- 
tors, ecc.) 

The culture Is inherently biased; bias in tests 
is being^ minimized; don't blame the messenger; 
testing helps miniorlties. 

Test companies try hard to curb abuse, educate 
users. 

* (Continued) 
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TABLE 18 (i^ontinuca) 



II. Debate About Quality of Standardized Machine-Scored Tests Vsed PrLmarily for PrcdLction 
Critics of Standardized Tests Defen ders of Stan dardized Tests 



Tests concentrate on easily measured cog- 
nitive skills, ignoring higher level skills 
(e.g., pT blem solving), imagination, cre- 
ativity, etc. 



Theo/y upon which testing rests is simplis- 
tic, outdated and sketchy. 



Test information is piuch less precise than 
testers pretend. 

Tests are seldom valid even by test makers' 
standards . 

Tests are developed subjectively and always 
contai||. controversial items. 



Society values intellectual achievement, cog- 
nitive skills; education (especially higher 
education) stresses those skills; otliers 
(e.g., teachers) are better able to assess 
imagination, creativity , etc. 

Theory upon which education rests may be sim- 
plistic, outdated and sketchy; test theory is 
better than critics think and always 
improving . 

Test information is improving in precision 
and is better than massive subjectivity. 

Many tests are rigorously validated and most 
what they are designed to do. 

Tests are developed by educators and scholars, 
some of whom always disagree with others; in 
the main, they do what they are supposed to 
do. 



Test scores do not predict success in later 
lifa. 



Test scores accurately predict such things 
as academic success in firsC year of college, 
first year of medical or law school, etc.; 
they are not designed to predict success in 
later li f e . 



Formal qualities of multiple-choice tests con- 
vey messages that undercut reasoning skills, 
writing ability, accurate perception of the 
world. 



No empirical data are oftered to support 
such fears; testing consumes too little of 
a stuc?ent's time to have such effects. 



III. Debate About Need 
P ro-Legislati on Sen timen«:s 

Grade inflation, misuse have conibined to 
give tests too much influence in admis- 
sions deci?*ons. 

A commitment to "truth in lending," "truth 
in advertising," sunshine laws and consumer- 
ism should pxtend to an area as important as 
admissions testing. 

Because a-inkseions tests have such influence, 
there is a/il overriding public Interest at 
stake. * I 

I.egis-Iation will -promo^. greater accur.icy, 
validity of tests. ^ ^ 

Legislation will encourage use of multiple 
^ ^crlte/ia in selection process. 



for Testing Legislation 

Antiiegisl ation Sentimen ts 

Higher eJucation*s need Cor students lias 
lessened importance of admissipps test 
scores . 

Test publishers and higher education institu- 
tions already provide ample information and 
protection; analogies to consumer movements 
are misleading. 

'["^lure are several competing public interrsLs 
at sta'te; critLcs have not established an 
overriding need for legislation. 

Legislation calling for full disclosure 
will lower the quality of tests- 

Most Institutions already use multiple cri- 
teria and t' st .ig-ncles encourage the 
practice. . ri 
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lABLE 18 (Continued) 



III. Debate About Need for Testing legislation (Continued) 
Pro:le^sj_atlon Sentiments Ant3 legisUtion Sen timents 

The admissions test industry is not account- The industry is accountable to the psycho- 

able to anyone. Tietric profession, marker, forces, academic 

coramuni ty . 

Federal legislation would constitute d^.a^er- 
ous, if not uncoustitutional, federal incur- 
oion into educati a. 

Legislition interfered with First Amendment 
ri/,l;t of colleger) to determine who they want 
to tjach. 

IV. Debate About Full Disclosure and Other Aspects of LegisJation 
Arguments Against Full Disclosure 
Students cannot learn much from examining their test items. 

Teachers may try to increase aptitude test scores by teaching the test items, thus damaging 
curriculum. 

Full disclosure will compromise tesr security; compromised security means less confidence in tests. 
Release of items will lead to invalid interpretations and misunderstandings. 
Accumulation of disclosures over the years will erode test quality and utility. 

Good items are the resuJt of a cosily, technical and professional process; they should be husbanded 
to have long life. 

Sample tests are sufficient. 

It makes morci sense to disclose a full specimen of the test before the test taking session, so 
test taker knows what to expect. 

Disclosure will remove economic competitive incentive to create new and better tests. 

If adnilsslons officers lose confidence in test scores, disadvantaged students will suffer. 

Disclosure means fewer test aH..,inistrat ions per year in order to keep a test secure as lon2 as 
possible. 

Disclosure will Increase test development costs, thus the cost of tests to students; poorer stu- 
dents will suffer. 

Disclosure will decrease amount of time available for development, leading to greater possibility 
of biased items creeping into tests. 

Disclosure will benefit expensive coaching schools, further hurting poor students. 
Disclosure makes comparability measurement more difficult. 

Disclosure requirement constitutes seizure of private property without due process and m viola- 
rlon of proprietary rights protected by copyright laws. 

Counter Arguments About Full D is£lo sure 
Students can learn about tests and test strategy from examining tfest questions. 

Security need not be an issue; new measun ment technology could enable testers to eliminate the 
pioblem. 

Development costs would not Increase as much as testers suggest. 

J . > 
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lABLE 18 (Jontfnio.d) 



Liounter Argumen t s About Full Dis closure^ (Cunti Kucd) 

Items now aval\ible only to expensive coaLhing schools would be available to everyone, beiielitmg 
poor students. 

There are many solutions to the comparability problem; the laws do aot adversely affect comparabil- 
ity measurement. 

The fairness issue takes precedence over technical matters. 
Disclosure will help admissions officers as well as studentsj. 

Argumetic ; Against Release of All Studies^, Evaluations or Statistical Reports Pertaining to a Test 
(para. 341, New York; Sec. 4(a)(1)(A), Weiss Bill) 

These provisions may interfere with academic and institutional freedom in violation of the First 
Amendment of the U.S. Constitution. 

SOURCE: Rexford Brown and Merle Steven McClung. Scarchintj for trie Trutn a})Out "Truth In ^ting" 
L^gii3latton: A Background Report, Denver, CO: Education Commission of the States, 
1980, pp. xi-xiii. 
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USES OF TEST SCORES BY THE COLLEGES 



There is considerable controversy surround- 
ing the appropriate uses and possible misuses of 
college admissions test scores. Critics of 
standardized college admissions tests allege 
that test scores are routinely abused. Citing 
examples of stud^^nt^ who have been denied admis- 
sion to the college of their choice by as few as 
five test points, they maintain that test scores 
are often the sole c^'iterion used by admissions 
committees in determining who is accepted and 
who is rejected at postsecondary institutions. 
Beleaguered admissions committees, critics claim, 
are tempted to use easily quantified objective 
indicators such as test scores rather than rely- 
ing on other subjective indicators of college 
potenfial such as a student's previous accomplish- 
in- s, letters of r»?commendation, personal inter- 
views, aspirations and goals, and motivation. 
[258:169] Additionally, they point out that in 
some cases cutoff scores are set so high that 
thousands of qualified students are rejected out- 
right so that their credentials are never even 
reviewed. [93:B5] Because they believe college 
admissions tests are so widely misused, anti- 
testing forces advocate abandoning them altogether 
They urge institutions of higher educatirn to fol- 
low the examples of Bowdoin College ana the Uni- 
versity of Wisconsin which have dropped their 
SAT requirements. [286:A2] When college admis- 
sions officers make decisions which have substan- 
tial impact on the lives of Individuals, siibjec- 
tive measures are better indicators of a student *s 
potential to perform college-level work, testing 
critics contend. [188:xiv] 

o 
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College admissions officers, on the other 
hand, assert that test scores are not the sole 
criterion used in determining admissions to 
postsecondary institutions . As professionals 
they are aware of the limitations of tests and 
they watch for their possible misuse. While 
test scores do play an important role, they are 
almost always supplemented by various subjective 
measures to provide a profile of a candidate's 
ability to compete successfully in college. The 
argument about the SAT, they state, is not about 
college admissions per se but about who is ad- 
mitted to a few highly selective colleges and 
universities such as Yale and Stanford. [85:42] 
Test makers have observed that concern about the 
use of test scores comes at a time when college 
enrollments are declining and when there is less 
pressure to gain admittance to college compared 
to the early 1970s. [57:11; 44:1] Nevertheless, 
they are concerned that attempts to abandon ad- 
missions testing may result in heavier reliance 
on subjective measures which may be influenced 
by social and racial bias. [173:A-19] While ad- 
missions tests are not perfect indicators of a 
student's college potential, test sponsors view 
them as a democratizing intluence which promotes 
fair and equal access to higher education, espe- 
cially for minorities and students from less 
weli-known high schools. [47:3] 

A recent survey of undergraduate admissions 
policies, practices, and procedures, conducted 
by the American Association of Collegiate Reg- 
istrars and Admissions Officers (^\ACR^\()) and 
the College Fintrance Examination Board has shed 
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ccribidcrable li^ht on thv inport<iutt' of admis- 
sions test iicores m ,idmis^»iuns dt^^ision m.ikiag 
the minimum SAT scores requiic-d bv pos t set t:)ndarv 
Institutions, tind other informatit^n reldtt'd to 
the c)lluge *idmLsSions process. 

Survey of Undergraduate Admissions 
Policies, Practices, and Procedures 

During the winter and spring of i978-79, 
x\ACR.\0/CF.EB surveyed 2,623 public and private 
two-year and four-year colleges and universities. 
A total of 1,463 institutions (55.8 percent) re- 
sponded. Including 401 public two-year cjI leges, 
81 private uwo-year colleges, 333 public four- 
year colleges, and 648 private four-year colleges. 
[218:1] According to James E. Nelson, vice- 
president for program research and planning at 
the CEEB, the survey established "the first sub- 
stantial baseline of data about college admis- 
sions practices." [44:2] The majority of colleges 
that use admissions lesL scores moyt often employ 
them to indicate whether an applicant may have 
difficulty in completing the academic prcgiam 
without special as$istance; review the scores as 
part of an overall evaluation of an applicant's 
credentials; and^'inform students of tlie general 
academic level of the institution by incorporat- 
ing them into a freshman profile. [4<^:4-5] High- 
lights of the A/^CRi\()/CEF.B survey follow . 

Importance of test scores in admissions. — 

According to the CEEB, relatively few colleges 
rely solely on admissions test scores in the 
decision making process. As shown in Table 19, 
less than one percent of private four-year col- 
leges and less than four percent of public four- 
year coljeges Identified test scores such as the 
SAT and ACT as the < ingle mi)St important factor 
in the admissions process. However, 54 percent 
of the private four-year colleges and nearly 60 
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l^iTL ent ol the pub In. rt)ur-v<-'<ir colleges con- 
sidered test scores to be a ve-ry impt)rt.int lac- 
tor. Ne<irlv 4() jK*rtent ot thu private four-year 
colU-ges and slightly mure than 27 percent of 
Liie public four- year college-^ rcfjorted tliat test 
sc(^r^s were eitlier onv ot several factors or a 
minor factor m the .idmissions dec i sion . [ 44 : 3 J 

Minimum SAT score cutoff points. — 

Forty-two percent of responding private four-year 
colleges and '38 percent of responding public 
four-year colleges reported having minimum SAl 
scores. (Table 20) The mean SAT verbal and 
.nathemat ical scores for those institutions were 
734 and 740, respectively. Although 22 percei t 
of the private two-year colleges compared to 
four percent of the public two-year colleges 
required minimum SAT scores, the mean SAT ver- 
bal and mathematical scores were higher at the 
public two-year colleges (650) than at the pri- 
vate two-year colleges (617). Tiiirty percent 
of all colleges surveyed indicated that they 
had "minimum standards" for scores on the SAT; 
mean test scores at these institutions was 740. 
[44:2. 8] 



Freshman applicants accepted,-- Private four- 
year colleges, which m<iny people think of as be- 
ing very selective, reported accepting nearly 78 
percent of all applicants, while public four- 
V ear colleges accepted 79 percent of all appli- 
cants. (See Table 21 on page 104,) Ihe compa- 
r<ibl e f igures for pr i vate and publ ic two-year 
colleges were 86 percent and 91 percent, respoc- 
tively. [218: 3J Tames Nelson of the (>IT:B said, 
"the problem may be that the public mostly hears 
ab(Hit only a few very select, {)resLigious col- 
1 eges . In f ac t , the vas t m.i j or i t v t)f <'o 1 1 eges , 
four-vear and two-year, public .ind piivate, »irt' 
mil that h<ird to get into.'' [44:4) 

1 ' ' 



103 



FABI.K 19 .--Importance of AdmissLons Test Suores in Decision Making, 
by I vpe of [nh^titut ion 



Single Most Impor- 



Test Scores Public Public ~ PrivatV 

. Two- Year Four -Year Four-Year ; wo- Year 



Pri va te 



* 



tant Factor 1.2/. },bK .9'. 



Very Important 

Factor 9.0 59.5 54.2 33.8 

One of Several 

P^icnors 14.7 23.1 35.2 35.8 

A Minor Factor 8.2 ^^'^ 4.2 ^^'^ 4.3 ^"^'^ 13,6 "^^'^ 

Do Not Review/ 

No Response (S8.9 9.6 5.4 12.3 



* 

Percent of all institutions in study group. 



SOURCE: "College Board Releases Early Report of College Admissions Study," i^cvr from th. Colic j^: 
hoard, November 1, 1979, p 9. 



TABLE 20.— Minimum SAT Scores Below Which Applicants Generally Are Not 
Considered Eligible for Admission, by Type of Institution 







Public 
Two-Year 


Public 
Four-Year 


Private 
Four-Year 


Private 
Two- Year 


All 
Colleges 


Percent with any 
SAT minimum 


4.0%* 


37.9?^ 


42.0% 


22.2% 


29.5% 


Minimum SAT V-M 
Mean 


** 

650 


740 


754 


617 


740 


Median 


642 


738 


751 


585 


740 



it 

Percent of all institutions in study group of this kind. 

** 

The mean or median for those reporting any minimum SAT score cutoff. 



SOURCE: ••College Board Releases Early Report of College Admissions Studv," from the Col egp 

Board, November 1 , 1979, p. 8. 
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TABLE 21. — Percent of Freshman \ppl leant s Accepted .md Enrolled. 

by Type of Institution 



Percent of 
Students 



Freshmen Applicants 
Accepted fo r 
Admission 

Mean 
Median 

Freshmen Applicant s 
Actually Enrolled 

Mean 
Median 

Accepted Freshmen 
Applicants - 
Actually Enrolled 

Mean 
Median 



Public 
Two -Year 



90.7% 
93.7 



77.3% 
81.4 



81 . 3% 
84.4 



Public 
Four-Year 



78. b:^ 

81.3 



53.2% 
52.0 



65.8% 
65.4 



Pr iVc te 
Four-Year 



77.5% 
81.7 



47.7% 
45.5 



59.8% 
57.6 



Private 
Two -Year 



86 . Zl 
90.9 



65.5% 
68.2 



73.5% 
74.7 



SOURCE: "An Overview of Findings from the College Board-AACRAO Survey of Undergraduate 

Admissions, Policies, Practices and Procedures." Prepared for the annual meeting 
of the College Board, October 30, 1979, p. 3. 



SAT •core expectations.- Approximately 45 per- 
cent of private four-year colleges and 44 per- 
cent of public four-year colleges reportec* that 
higher admissions test scores were expected from 
applicants in 1970 than 1978. [44:2, 8] The 
comparable figures for private and public two- 
year colleges were 48 percent and 34 percent, 
respectively . 

Minimum grade point average cutoff point. — 

Nearly 58 percent of private four-year col- 
leges and 43 percent of public four-year col- 
leges indicated that they had a minimum grade 
point average below which applicants were 
generally not considered eligible for admis- 
sion. However, more that three-quarters of 
the colleges reported that the minimum parade 
point average was "C" or below. [44:2, A] 



In a 1980 interview with KduoaiLofial 
lieacLrship y Fred A. Hargadon, dean of admissions 
at Stanford University and chairman of the Col- 
lege Board, emphasized that most institutions 
use cutoff scores "only when a student *s grades 
fall below a certain level." Hargadon cited 
the California system where admissions person- 
nel check test scores to see if they are high 
enough to offset poor grades, a procedure which 
is different from setting a cutoff score without 
reviewing other criteria. Recent data from a 
consortium of JO colleges and universities in- 
cluding Stanford, Harvard, the University of 
Chicago, and NoL'tbwestern showed that in 1978, 
430 individuals with SAi^ verbal scores between 
750 and HOC were turned down, but 5,^Ji individ- 
uals with SAT-V scores, between <\\n\ 350 were 
admitted bv those institutions. l'3:b')b] 
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Credentials required of applicants. — Credentials 
most frequently required by all institutions were 
a complete high school transcript or evidence of 
high school graduation or a General Equivalency 
Diploma (GED) . (See Table 22 on page 106.) 
Over 92 percent of the private four-year col- 
leges ranked the complete high school transcript 
first In the credentials required of all appli- 
cants, compared to 79 percent of the public foui- 
year colleges. Both private and public four-year 
colleges ranked admissions test scores such as 
the SAT and ACT third In importance, while pri- 
vate and public two-year colleges ranked them 
fourth. Private four-year colleges also placed 
much more emphasis on subjective measures such 
as letters of recommendation. Interviews, and 
personal essays than public four-year colleges. 
(44:3, 10] 



Exceptions to formal admissions requirements by 

•elective colleges.*- Over 92 percent of the pri- 
vate four-year colleges and 80 percent of the 
public four-year colleges Indicated they had 
"selective" admissions requiremeiits . (See 
Table 23 on page 107.) But, 54 percent of r.he 
private Institutions and 62 percent of the pub- 
lic Institutions said they made exceptions to 
their formal requirements for admission. Dur- 
ing fall 1978, seven percent of the freshmen 
admitted to private colleges and nine percent of 
the freshmen admitted to public col lej^es were 
allowed exceptions to regular admissions require- 
ments. Both pri /ate and public four-year col- 
leges reported tho*" exceptions were most often 
made for adult «<ludents, disadvantaged students, 
and members of racial/e thnic^^jpi«orit y groups. 
(218:171 V 



Sublectlve Judgments of applicants' personal qual- 
ities.- As presented n Table 24, 91 percent of 
the private four-year colleges and 59 percent 
of the public four-year colleges ranked student 
motivation or initiative first in the list of 
personal qualities thai their admissions staffs 
would consider in determining a student's admis- 
sibility. Private i3ur-year colleges ranked 
evidence ot ^ocd citizenship or moral character 
second (83.0 percent) and special skills or 
abilities third (80.1 percent) . Public four- 
year colleges lanked special skills or abilities 
second (56.7 percent) and work experience related 
to intended field of study third (47.5 percent). 
[218:5] 

High school course requirements: 1970 vs. 1978. — 

A listing of high school course requirements for 
admission to pos t secondary schools is given in 
Table 25 on page 109. The AACRAO/CEEB study 
indicated that course requirements for college 
admissions have varied little since 1970, with 
the exception of foreign languages. In 1970 
approximately 43 percent of the private four- 
year colleges and 20 percent of the public four- 
year colleges reported students having a mean of 
two-years of foreign language study compared to 
38 percent and 15 percent of these colleges, 
respectively, in 1978. The AACRAO/CEEB survey 
indicated that college admissions officers sel- 
dom rely solely on admissions te';t s^.ores in 
determining those who are admitted. [44:3] 

According to Rexford Brown of the National 
Assessment of Educational Progress and Merle 
Steven McClung of the Education Commission of 
the States, the AACKAO/CEEB survey data do not 
prove that institutions are not overestimating 
the importance of test scores or their accuracy. 
Brown and McClung contend that additional infor- 
mation is needed about the undergradunt,o and 
graduate selection process if the problem of 
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TABLE 22. —Credentials Required of All Applicants, by Type of Institution 



Credential 



Compl<*te Hjgh School 
Transcript 

Evidence of High 
School Graduation 
or GED 

Admissions Test Scores 
such as ACT or SAT 

Achievement Tost Scores 
such ds ACT» CLEP. 
Achievement Tests 

Letters of Reconnnen- 
dation 

Interviews with 
Admissions Staff, 
Faculty, Alumni 

Personal Essay or 
Autobiographical 
Statement 

Health Statement 

Portfolio, Statement, 
Audition, etc. 



P ublic Two- Year 
Rank* Percent** 



54.7% 

56.3 
18.0 

1.2 
1.3 

7.3 

2.0 
33.7 

] .0 



Public Four -Year 
Rank Percent 



)9,3a 

82.9 
65.8 

4.3 
7.1 

} .3 

10.0 
54.0 

2.8 



Private Four-Year 



Rank 



Pe rcent 



92.2;: 

86.6 
74.0 

16.5 
63.0 

18.1 

44.9 
63.2 

10.1 



Private Two -Year 
RaniT " FeTcent 



90. 8Z 

87.0 
56.9 

6.0 
53.3 

24.5 

15.8 
73. b 

8.9 



Frequency of reporting requirement of all applicants. 

Percent of responding institutions which require credential of all applicants. 
SOUKCK: "College Board Releases Early Report of College Admissions Studv," Ncb)r> from the JoLl.i.jr bocipd November 1 1979 

p. 10. , ^ y y 
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TABLE 23.— Exceptions to the Formal Requirement., for Admission. Selective Institutions. 

by Type of Institution 



Public 
Two-Year 



Percent who are selective 

Percent of selective institutions who make 
exceptions co formal requirements 

Number of exceptions as a percent of the number 
of freshmen admitted, fall 1978 
Mean 
Median 

In 1970» the number of exceptions was 
Higher 

About the same 
Lower 

In the mid-1980s, the number of exceptions will be 
Higher 

About the same 
Lower 

Exceptions could be made for 
Athletes 

Alumni relatives / 
Faculty relatives 

Mer,bers of racial/ethnic minority groups 

Disadvantaged students 

Physically handicappe'd students 

Students with ppecial talent in art» music, etc, 

Adult students 



Public 
Four-Year 



Private 



Private 



9.4% 



80.0% 


92.3% 




65.4% 


62 . 1%** 


53.9% 




39.6% 


8.9% 


6.Q% 




4.1% 


4.0 


4.0 




2.0 


15.9/.*** 


20 . 21 




22.2% 


58.5 


59.4 




63.9 


25 .6 


20.4 




13.9 


17.5% 


14.1% 




21.1% 


77.0 


79.3 




76.3 


5 .5 


6.6 




2.9 


43.3%** 


24.2% 




17.0% 


24.6 


33.4 




30. 2 


26.5 


30.3 




32. 1 


30.0 


41.6 




30.2 


51.1 


38.7 




20.8 


39.0 


29.7 




24.5 


42.0 


30.2 




18.9 


53.8 


44.9 




47.2 



rhe number of public two-year institutions who are selective is too small for meaningful descriptions. 



A** 



Percent of all institutions in the study group. 

Percent of respondents who said they made or could make exceptions. 

SOURCE: '^An Overview of Findings from the College Board-AACRAO Survey of Undergraduate Admissions, Policies, Practices 
and Procedures." Prepared for the annual meeting of the College Board, October 30, 1979, p. 17. 
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TABLE 24. — Percent of Respondents Who Would Consider Subjective Judgments of 
Personal Qualities, by Type of Institution 



Public Two-Yi^ar Public Fo ur-Year Private Four-Year Private Tvo -Year 
^ Factor Rank Percent Rank Percent Rank ? Percent Rank Percent 

Leadership 

capabilities 6** 11.3%* 4 44.1% 4 78.0% * 4 63.2% 

Community or church 

involvement 7 5.0 7 28.6 6 72.6 6 59.7 

Motivation or initiative 2 22.5 1 58.7 1 90.9 2 82.9 

Work experience related 
to intended field of 

study ' 1 28.8 3 47.5 7 65.0 7 57.9 

Compatability between 

institutional qualities * 

and student needs 5 14,0 5 40.5 5 77.3 4 63.2 

Evidence of good citi? en- 
ship or moral character 3 21.8 6 37.8 2 83.0 ' 1 83,1 

Specifil skills or 

abilities 4 19.9 2 56.7 3 80.1 3 65.8 



Percent of respondents who said that factor was sometimes or often important 

A* 

Relative frequency with which factor was identified 

SOURCE: "An Overview of Findings from the College Board-AACRAO Survey of Undergraduate Admissions, Policies ♦ Practices and 
Procedures.'* Prepared for the annual -weting of the College Board, October 30, 1979, p. 5. 
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TABLE 25.— High School Course Requirements in 197C ana 1978, 
by Type of Institution 



High School 
Subject 



1970 
Lr.^l ish 

Mathematics 

Physical Sciences 

Biological Sciencf^s 

Social Studies 

Foreign Language 

1978 
English 
Mathematics 
Physical Sciences 
Biological Sciences 
Social Studies 
Foreign Language 



Public 


Two-Year 


Public 


Four-Year 


Priv.ite 
Anv 


Four-Year 


Private 


Two-Ycar 


Any^ 


Mean** 


Any 


Mean 


Mean 


Anv 


Mean 


19.2% 


3 


. 7 


56 


.5% 


3.6 




1 Q 
J . O 


56 . 8% 


3.8 


16.0 


2 


.0 


52 


.9 


2. J 


67.6 


2.3 


49.4 


2.0 


12 . 2 


1 


.6 


38 


. 4 


1.2 


50.3 


1.3 


30.9 


1.2 


12. 5 


1 


, 5 


43 


» J 


1.1 


55.9 


1.2 


42.0 


i.2 


14. 2 


2 


.5 


47 


, 1 


2.1 


61.3 


2.1 


46.9 


2.0 


3. 7 


2 


9 


20 


4 


2.0 


42.9 


2.1 


18.5 


1.9 


16.5 


3 


7 


55 


6 


3.7 


71. V 


3.8 


65.4 


3.8 


13.2 


1. 


9 


51. 


1 


2.1 


69.8 


2.3 


53.1 


2.0 


10.2 


1. 


3 


35. 


7 


1.2 


51.4 


1.3 


34.6 


1.1 


LO.O 


1. 


3 


40. 


5 


1.1 


56.8 


1.2 


^5.7 


1.1 


11.7 


2.3 


44. 


7 


2.0 


63.1 


2.1 


53.1 


2.1 


2.0 


2. 


5 


14. 


7 


2.0 


37.5 


2.1 


11.1 


1.8 



Percent of responding institutions which reported a specific number of years* study roquiri.'U 
The mean number of years for those reporting any specific requirement 

SOURCE: "An Overview of Findings trom the College Board-AACRAO Survey f Undergraduate Admissions, Policies Practices 
and Procedures. Prepared for the annual meeting of the ColK^o Board. October 30. 1979, pp. 6-7. ' 
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alleged tast abuse is to be solved. In order to 
ascertain if institutions abuse test scores, 
they have suggested that it would be helpful to 
survey admissions officers to etjtiraate their 
knowledge about the characteristics and limita- 
tions of admissions tests. They further suggest 
that it would be useful to analyze the data that 
test publishers make available to test score 
users: "Are their handbooks and explanatory 
materials readily understandable?" "Do they 
explicitly emphasize test limi'^ations or are 
rhe limitations only implicit In statistics 
that few readers will attend to or understand?" 
"Are the handbooks and materials widely available?" 
"Are they updated often?" "What do admissions 
people do with the handbook?" f'34:52 ) 

Survey of College Admissions Officers 

Another survey of college admissions prac- 
tices focused on the weight of grade point aver- 
age, rank in class, and other criteria used in 
detertnininR a student's admissibility to college. 
In response to a request by the Fairfax County 
(Virginia) Board of Education, Nancy Kokus, a 
guidance project specialist, prepared a report 
on the county's grading system and its Implica- 
tions for students. Included in the 1979 report. 
Revision of Grading Soale — Report to 'Jchool Board, 
was a survey of 21 college and university direc- 
tors of admissions. Each director was asked to 
comment on the Fairfax County Public Schools 
(FCPS) grading scale in the selection of appli- 
cants. Since there is great variability in the 
assigned percentages equivalent to letter grades 
nationwide, Fairfax County wanted t .v. -w if Its 
grading practices placed its student:} at a disad- 
vantage in the admissions process. (KCPS* grad- 
ing pcale is: A-94-100, B-87-93, C*80~86, D»70- 
79.) Highlights of the^ responses from the col- 
lege iiu! university admissions officers follow: 
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• Amherst College ; "We look very carefully 
at each and every course that the student 
takes and, of course, how the student 
fares in each of these courses. What we 
are most concerned with is the kind of 
academic Program which the student is 
following, i.e., we are looking for a 
demanding, rigorous academic program 
throughout the student's etit Ire high 
<^chool program, and not necessarily the 
overall grade point average, [emphasis 

in the original] An A in an advanced 
placement course Is much more meaning- 
ful than an A in a course which is not 
as challenging. " 

• Brigham Young Uaiversitj : "At Brlgham 
Young University we use a combination 
of high school grades and test scores 
from standardized tests such as the ACT 
and SAT to determine a student's admis- 
sibility. It Is difficult to assign a 
weighting or to describe the weighting 
that we attach to each because that's 
put into what is known as a regression 
formula and the weighting is different 
each year depending on certain charac- 
teristics. The rank in class does pro- 
vide us Important information that we 
look at In determining scholarships 
and also admissions for marginal 
students." 

• Duke University: "We base our decision 
for admission on the total appeal of the 
student's application in light of its 
component parts. Special emphasis is 
given to (1) secondary school academic 
performance; (2) standardized test 
scores; (i) extracurricular Involvement; 
and (4) the secondary school's recommen- 
dation. We make every effort to evalu- 
ate the student's academic record in re- 
lation to opportunities available to him 
in his school setting. In evaluating 
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the secondary school record, we rely heav- 
ily on the expla»iator> information pro- 
vided by the secondary school. Our under- 
standing jifferenc grading systems 
and of varying curricular offerings i& to 
a large extent dependent on profiles and 
other data provided by the secondary 
school, such as transcriptij which would 
show variations in grading skills. Cla^^ 
ranks, weighted or unweighted, or decile 
ratings are helpful in the t^ecision making 
process. However, we are careful not to 
Jeopardize any student for whom a rank or 
rating is not presented by carefully con- 
sidering other indicators in his academic 
record. " 

• East Carolina University : "East Carolina 
University places more weight upon the 
grade point average or the class rank, as 
given to us by the secondary school, in 
determining the admission status of an 
applicant 

• University of Florid a; "The affect of 
class rank in assessing a student *s ap- 
plication is minimal. We do closely 
weigh, however- an academic grade point 
average. . . . This office attempts to 
consider the grading scale when reviewing 
an applicant *s grade point average and 
admissibility to the University of 
Florida.*' 

• Harvard-Radclif fe ; "Harvard simply takes 
all the information it can get on every 
single applicant, from grades and scores, 
rank in class, extracurricular b^^nors, 
indlviduaX talents and most importantly 
of all, witltten observations of an inci- 
sive nature from counselors and teachers 
In order to help us separate students 

who will look very similar on paper. . . . 
We do tend to rely very heavily on the 
subjective data. . .to help jpllt hairs 
among students who are very, very strong 
on objective grounds." 

o 
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• ' -.iies Madison University (Harrisonburg, 
Virginia): "Preference is given to 
those applicants whose program of stud- 
ies in high school exceeds published 
minimums. No specific 'weight' is 
placed on tiie grade point average or 
class rank in reaching an admissions 
decision. Consideration is given to 
such factors as academic preparation 
and performance, scores on standardized 
tests, interests of the appUcant , ^ 
potential for enhancing the diversity 
of the University Community." 

• Massachusetts Institute of Technology : 
"The important thing, from our point of 
view, is that whatever grading scale is 
used, it allows us to compare the qual- 
ity of intellectual content in a stu- 
dent's performance in a particular sub- 
ject with other students. We are inter- 
ested in using a rank-in-class , for it 
allows us to compare the students within 
your school. We ha^je never felt rhat 
grade point was a particularly good way 
of comparing students from one schoo^ 

to another and do not d. that. . . . 
It is important for schools to articu- 
late clearly whatever grading system they 
use on all transcripts." 

• Mount Holyoke College : "There is no 
question that a student's performance 
in high school is of the greatest im- 
portance in making admission decisions. 
We, like other colleges, find that the 
school record is the most important 
single criteria. We do try, however, 
to interpret all grades in the light of 
the particular school, the population, 
and of course, the grading system 
itself." 

• The University of North Carolin a : "As 
far as weight is concerned, we probably 
place about two^thirds of our emphasis 

on the total high school record, including 

J - 
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rank, but also including the method by 
which Che rank was derived, the quality 
of Che academic cour^'^ selection based 
on whac the school tias t«- offer, and 
other factors." 

• University of Notre Dame : "Grade point 
averages are not given much 'weight' in 
our evaluation of students; however, in- 
dividual grades in specific courses are 
important in our deliberations » Cla«3 
rank is an important factor in our con-- 
sideraLion. We recommend that schools 
follow the recommendations of the Na- 
tional Association of Secondary School 
Principals in determining class rank 
(weighting grades) when different levels 
of the same course are offered in the 
curriculum." 

• The Pennsylvania State University ; "Our 
admission decisions are based on an eval- 
uation index which is derived from the 
high school grade-point average in com- 
bination with the verbal score and the 
math score of •'he Scholastic Aptitude 
Test. The high 'school grade-point aver- 
age has about sixty percent of the weight 
in the evaluation index* In order to 
evaluate applicants as described above, 
we nust have end-of-year grades for all 
academic subjects. We use the grades 
exactly as reported by the se^onda**y 
school. If no grading scale were given, 
we would ask the school to provide one. 
While grading scales vary from school 

to school, grading practices also vary. 
Therefore it is difficult to say whet!ier 
a particular grading system places an 
applicant at a disadvantage." 

• Radford Co llege (Radford, Virginia): 
"The competition for admission may vary 
in any given year at Radford College. 

We review the *^tudent's application based 

on the rompetltion within the particular 

high school that the student attends. I <) » 

-^^ \^ 



Tlieretore, tiie grade-point average and 
rank-ln-class are important factots in 
reviewini' a student's application but 
arc not the only items considered in mak- 
ing the decision. Several schools in the 
State of Virginia do weigh the grades- 
point average by awarding mor^ credits 
for advanced placement classes. Other 
schools have eliminated high school rank 
which places much higher emphasis on the 
SAT's. ... We have rejected many ap- 
parently good students from schools who 
have eliminated class rank where the 
student's SAT scores have been below the 
national average." 

University of South Carolina : "The Uni- 
versity of South Carolina has a minimum 
SAT requirement of 350 on each part of 
the Scholastic Aptitude Test. Many peo- 
ple interpret this to mean a student 
with 700 may be admitted. . .a fallacious 
assumption. It is quite possible that a 
student with 1100 on the SAT will be 
denied admission. For example, an 800 
SAT verbal and a 300 math will not . . . 
routinely. . .quality the student for 
admission. On the other hand, a student 
applying for a humanities major with 
those scores. . .and a very good class 
standing would be admitted. ... We 
do not normally use raw grade point av- 
erage for admission, preferring instead 
to use the more informative rank in 
class. In the absence of rank, however, 
we have a formula which allows us to 
predict academic success based upon grade 
average ." 

Tex as A & M University: "The grade point 
average, of course, determines a student's 
class tank. Hiis in turn determines the 
SAI required for admission. At the pres- 
ent time we are requiring nonresident stu- 
dents to rank in the top fourth of their 
cT-^ss and score at least 1000 on the SAT." 
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• Cniverslty ol Vlr glnl_a; ''In our own ad- 
mission process, we pay more attention 
to class rank and to the relative 'iiffi- 
cuity of each applicant's academic pro- 
gram, than to nunerical grades. Extra- 
ordinarily high or low grades always 
attract the attention of members of our 
Committee on Admissions; class rank is 
of greater importance." 

• West Virginia University ; "West Virgimr. 
University bases the admission decision 
on the grade point average. Class rank 
is not considered." 

• Ccllege of William and Mary: "William 
and Mary does not have a process whereby 
we assign 'weights' to specific factors 
in an applicant's credentials; rather 

we review the total record of each ap- 
plicant and compare it with other stu- 
dents applying for admission." 

• Yale University ; "While grade point 
average and class rank are certainly 
considered, they ere always assessed in 
two 'contexts': the context of the stu- 
dent's general academic environment 
(achool system, specific school, course 
selections, etc.) and the context of 

the Individual application itself — which 
of course contains much important infor- 
mation which is not academic at all. 
Thus, we do not assign a sCandari 
'weight' to these factors, but instead 
try to judge each application, to some 
extent, on its own terms." 
As the letters to Kokus from the admissions 
officers show, many of the institutions surveyed 
do not use a specific predictive formula for mak- 
ing admissions decisions. The quality of stu- 
dents' academic program and high school achieve- 
ment reflected by rank-in-class were of prime 
importance, with rank-ln-class generally con- 
sidered more important than grade point average. 
Teat scores were used In conjunction with other 
factors such as academic preparation, class rank, 
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grade point averagp, student interests, and 
counselor/ teacher recommendations. Several col- 
leges reported that it was beneficial when sec- 
ondary schools proviaed a profile that included 
all possible inforniatiou about the school and 
Its programs, including th't population, tfie 
distribution of grades, and the courses offered. 
As tor the FCPS ' grading scale, none of the in- 
stitutions surveyed indicated that it would place 
the county's students at a disadvantage in the 
admissions process. [147;11J 

An April ] 980 article that appeared in the 
Washinjton I'oct described the admissions process 
and the inethod by which candidates are selected 
at Georgetown University In Washington, D.C. 
During the past decade, the number of applicants 
to Georgetown rose by nearly 80 percent while 
the chances of being admitted have declined from 
57 percent In 1971 to 30 percent In 1980. Of the 
7,843 high school seniors applying in the spring 
of 1980, nearly three-fourths never made it to 
the admissions committee. These students were 
either accepted or rejected outright based on a 
"mathematical Index, calculated from class rank, 
admissions test scores, and the competitive 
standings of different high schools." From the 
likely accepts and likely rejects, every appli- 
cation Is read by two admissions officers. 
Hundreds of low-scor2rs were selected for a 
second chance and many high-scorers had their 
scores palled down because of the type of high 
school courses taken, the quality of interviews 
with al».!mni or admissions officers, or the qual- 
ity of recommendations from teachers. Alumni 
relatives did receive some preference In the ad- 
missions process. According to admissions direc- 
tor Charles Deacon, "Most of the people in the 
'likely reject' group would be able to succeed 
her^y and we want to take some of them. We don't 
just accept from the top of the list autom;iti- 
callv." (93;n, 33] 

Although teat scores atu important m the 
adml ss Ions process , part icularly i f a si udent 
is applying to a selective college or university. 
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It Is apparent that ocher meahures such as a 
student's special talents, accoraplishmenth , 
experiences. Interests and goals are Important 
and may beconie Increasingly Important, Accord- 
ing to the Educational Testing Service, new 
ways are needed to Insure a fair judgment of 
those personal qualities. Currently, ETS is in 
the middle of a tlve-year project to aid col- 
leges and universities In understanding how in- 
formation about personal qualities can supple- 
ment test scores and grades In the recruitment 
and retention of students. The Personal Qualities 



in Admissions pioject, conducted by KTS in 

joperation with nine institutions (Bucknell 
University, Colgate University, Haitwick Col- 
lege, Kalamazoo College, Kenyon College, Occi- 
dental College, Ohio Wesleyan University, the 
University of Richmond, and Williams College), 
is studying the academic and personal back- 
ground of 25,000 applicants at these institu- 
tions. It is anticipated that the results of 
the study will '^support a broadened view of 
admissions," [57:11] 



ERIC 



115 



HOW TEST SCORES MIGHT BE IMPROVED 



On one end of the testing controversy, anti- 
testing forces led by Ralph Nader have called for 
the abolition of admissions tests. [68:2] Other 
test crirlcs like Allan Nairn have argued that 
additional criteria should be used to evaluate " 
a candid,:ite's potential to perform college level 
work, rather than relying on a single testing 
instrument from a single organization. [188:383, 
385] The National Education Ass. elation (NEA) has 
called for free coaching schools for all students, 
especially for those from lower socioeconomic 
groups, minorities, and women. [19A:26] Testing 
critics contend that the existence of coachable 
admissions tests creates financial barriers to 
cjpcational opportunities, in direct conflict 
with congressional policies calling for equal 
educational opportunity. [90:2] In addition, 
they state that standardized tests have excluded 
individuals fiom college, graduate schools, and 
Jobs by as few as five test points. [166] 

At the other end of the spectrum, the Col- 
lege Board has asserted that there is no evidence 
that reasoning abilities "can be taught over a 
Short duration." [121:4] ETS has maintained that 
institutions using admissions tests are aware 
that assessments of student characteristics are 
not infallible, and that the SAT, although not 
perfect, it is still the best predictor of col- 
lege success when combined with high school 
grades. [77:25] Standardized admissions tests 
were designed to help individuals and institu- 
Uons at transition points from high school to 
College, from college to graduate school, and 

o 1; 
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from education to work, but "nobodv is kept out 
of college because of a test score." [123:1; 
47:5] 

In spite of these opposing points of view 
between the test agencies and their critics, 
there are many factors such as students' atti- 
tudes and motivation, testing conditions, and 
familiarization with test raking skills and 
test content which exert some infJuence on ad- 
missions test scores. Most discussions about 
now to improve test scores, however, focus on 
special preparation or coaching. 

Perspectives on How Test Scores 
Might Be Improved 

There is no indication that the debate 
over appropriate methods of improving SAT and 
ACT test scores will end soon. Many schools 
are altering their curricula in an attempt to 
raise t^eir students' SAT scores and it has 
been estimated^fehat nearly one-third of the 
public and private schools in the Northeast 
now offer some type of SAT preparation course. 
[13:1] This increase of coaching courses in 
the nation's high schools will, according to 
the NEA, "further the argument that the SAT is 
the first course of study that will be taught 
in the country and, therefore, it provides the 
precedent for other courses to be used in the 
development of a national curriculum." [194:31] 
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ETS, on the other hand, has emphasized that 
although the SAT is not perfect, test scores are 
not used alone in reaching admissions decisions'. 
(77:23] The American Association of Collegiate 
Registrars and Admissions Officers, moreover, 
reported that less than two percent of selective 
colleges identified test scores such as the SAT 
as the single most importaii^ factor in the ad- 
missions process. (44:1 J Additionally, the Col- 
lege Board has stressed that research J^tudies 
have consistently shown that students cannot in- 
crease their test scores significantly by inten- 
sive drill. They have .stated that research 
studies, where score Increases have been gauged 
as a result of coaching, showed average Increases 
of under 10 points, less th^n Increases students 
can expect between the >^rtnfe of their junior 
year and winter of their senior year. [50:3] 
The College Board has expressed concern that 
the release of test questions and answers would 
encourage teaching for the test and increase 
coaching acti^'ltles. [46:3] 

The following letters, official statements, 
and memos from well-known educators, officials 
of testing organizations, and critics of admis- 
sions tests provide a cross-section of the most 
recent points of view of their respective organi- 
zations and their personal opinions regarding the 
controversial topic of how test scores on the SAT 
and ACT might be improved. 

Rogei Far r, professor of Education at Indi- 
ana University and president of the International 
Reading Association, observed that **al though 
there are contradictory indications, there is 
some evidence from the NAEP data, SAT scores, 

it 

and the Indiana study that any decline that 



According to t^e National Assessment of 
Educational Progress (NAEP) data, basic llterac^ 
is at a high level. [87:530] The Indiana Study, 
conducted In 1976, compared the reading achieve- 
ment of sixth and tenth grade students to their 
counterparts in 1944-45. Using the same -edition 
of thft lotDa Silent Reading Tee to, It was observed 
that students in 1976 read as well as or better 
than students thirty years ago. [86:3] 

C 
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can be supported in reading achievement among 
r.S. students is one in higher, more, sophisti- 
cated levels of comprehension. Thus, msttead 
of responding to the alarm over the declining 
score issue with programs to assure more focus 
on subskills related to basic literacy, it would 
seem more appropriate to concentrate o the de- 
velopment of higher level comprehension. 

"Because background Information has been 
shown to be a very stiong influence on reading 
compiebension, yie purest way to promote higher 
scores on the verbal sections of tests such as 
the SAT should to promote wide independent 
student reading on a variety of subjects and to 
expand the background of students on a variety 
of topics through the use of various media. 
Since the surest motivation of expensive read- 
ing is interest, developing readers who read 
for their own enjoyment is a prime goal of 
reading Instruction. AL the same tlTie, there 
are alms based on the correlation of reading 
comprehension to thinking that should guide 
reading instruction if we are to c^evelop the 
kind of responses re^iuired of students on the 
verbal section of the S/ i . 

**A prime goal of teaching reading compre- 
hension should be to enable students to under- 
stand, react to, and incorporate or reject 
id^acy. [e^>hasis in tlie original] To under- 
stand, a student mu^t synthesize within and 
across reading experiences; thus .reading should 
be taught as an induction process that leads to 
Inference drawing as an intelligent guessing 
game . 

"To react, a student must analyze as he or 
she reads. Ihis involves such thinking habits 
as challenging [;;ene ral izat Ions with exceptions 
c^nd adding options as horns on dilemmas en- 
v.ountered in reading. It means rectj^nizing 
temporal and causal sequences and comparisons 
and other symbolism. Sucii training ought not 
be reserved for only higher grade levels, but 
it should be introduced in elementary grades, 
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vhere we tend now to concentrate on only literal 
comprehension. Inferential comprehension and 
cr1,tical reading begin with learning to use con- 
text clues for word recognition, a vocabulary- 
building practice that depends on the interre- 
lationship of words as ideas; they come too from 
the practice of predicting the context ahead as 
one reads . 

"To incorporate, a student must learn to 
test his or her understanding by using what has 
been learned from reading. This final step of 
comprehension is too often neglected in class- 
rooms at all levels, where utilization focuses 
on passing a test. 

"It is probable that another way to improve 
SAT scores would be to drill students on a high- 
powered vocabulary list, on roots and affixes, 
and on idiomatic combinations of verb plus ac- 
ceptable preposition. But the broad reading 
experience proposed above should develop the same 
familiarity with word/concepts in a more indelible 
wAy; and avoiding the drill will also avoid kill- 
ing the student's motivation for reading and the 
separation of language from connected ideas. 

"We could free our educational system from 
this temptation by discontinuing standardized 
testir.^ that assesses subskills as part of a 
total reading score. Diagnostic assessment of 
subskills could continue to guide teacher plan- 
ning, but we should stop pretending that we 
know how to prioritize such skills or how they 
interact in the comprehension process. For the 
same reason that encouraging lots of reading is 
the best way to develop readers, summative eval- 
uation of reading by testing should score only 
reading comprehension as the complex, total act 
that it is." tl55J 

Alan C. Purves , principal of University 
High School at the University of Illinois and 
president of the National Council of Teachers 
of English^ writes: "College aptitude tests 
llk^ the SAT*V concern themselves with latinat^^ 
vocabulary* with subtleties of nuance and tone, 
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and with the comprehension of complex pros^. 
Clearly students can be prepared for such tests 
through such devices as vocabulary drill, but 
more iirportantly through practice in the read- 
ing and analysis of a variety of complex mate- 
rial from Shakespeare and T, S. Eliot to essays 
and other texts by critics, philosophers, and 
persons of letters generally. Students need 
practice in close reading and in determining 
pr'^^isely the meaning, tone, and intention of 
these writers. Such practices need not run 
counter to other goals of schooling in English, 
such as the development of aesthetic response, 
of an expressive writing style, or of a breadth 
of information about language ^ general. In 
fact, a sound English program that does not 
eschew difficult texts nor a demanding Inquiry 
into the causes of a reader *s response would 
probably enhance a student's aptitude test 
score. Such a program need not concentrate on 
drill or other rote studies; these may, in 
fact, prove counterproductive. Together with 
careful critical reading, a writing program 
that emphasizes rhetorical effectiveness for a 
variety of audiences will enable students to 
score well on aptitude tests and to achieve 
good grades in college." [158} 

Shirley A. Hill , president of the National 
Council of Teachers of Mathematics, in a state- 
ment of the "NCTM Recoimnendations for School 
Matnematics of the 1980s," asserted that "school 
mathematics is rapidly approaching a crisis 
stage. Policy makers in education are not con- 
fronting the deepest problems because the pub- 
lic and its representatives have been diverted 
by a fixation on test scores. There are three 
major urgent problems: (1) school mathematics 
programs are not keeping pace with the changing 
needs for mathematical abilities dictated by 
developing technologies; (2) not enough school 
time ip devoted to ihathematlcs learning and 
most students are not taking sufficient high 
school mathematics to prepare them for their 

■ 131 
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futures, as workera^ consiuners or citizens; (3) 
there Is a growing shortage of qiKiHfied mathe- 
matics teachers in high school \ ematlcs 
classrooms." [129:1] NCTM recomir nded that 
(1) three years of mathematics 1 ;i.ades 9-12 
be required of all students, with diversified 
programs tailored to the different goals. In- 
terests, and abilities of studentr*, and (2) 
that students planning to go on to college or 
a vocational program that Includes mathematics 
enroll In matheodatlcs courses during the last 
year of high school. U29:2] With respect to 
the evaluation of mathematics programs, NCTM 
stated that '*test scores should not be used as 
the sole Index of success In mathematics pro- 
grams," and "the results of a test designed 
for purposes other than program evaluation 
(such as the SAT) should not be Interpreted 
as an evaluation of mathematics programs/' 
[191:15] 

Hill stressed that "these problems cannot 
be solved by schools, teachers or professional 
groups alone. The National Council of Teachers 
of Mathematics offers Its resources. Its ener- 
gies, and Its volunteer personnel In a massive 
cooperative effort during this decade. But 
essential to succes*^ Is the support and direct 
Involvemefit of the public and Its representa- 
tives." (129:3] 

Sheila Tobias , educator and author of 
Overcoming Math Anxiety, wrote that very high 
SAT scores served her well by Identifying her 
Intellectual potential and enabling her to be 
accepted at Radcllffe College. She explained 
that *'lt appears that coaching can be effective 
In preparing students for the mathematics com- 
ponent of the exams more than for the verbal 
component. ... . Fhere Is more of a consensus 
as to what would be the right answer among 
those who prepare math probleran. Confidence 
level of course enters ^In, but unlike the verbal 
section where, ^for\j^x^ple, the analogies test 
not only knowledge of meaning but the cultural 
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contaxt In which the analogy Is set, mathematics 
problem-solving skills can be Identified and 
perfected. For example, students can be trained 
In how to figure things out: If the problem ap- 
pears to be far from their previous experience 
In math, they might substitute simpler numbers, 
*:ry extreme cases, draw a diagram, and so on. 
Indeed, to the extent that Important skills are 
being tested (such as problem-solving, extra- 
polation from what has been taught, etc.) these 
skills should be taught In school, [emphasis 
In the original] 

"What we have learned about 'test anxiety* 
from years of working with math anxious and 
avoidant students may not be 'flxable.* They 
suffer stress when under time pressure; they 
need to read word problems out loud; the\ ke 
discussion to stimulate their own think i 
None of these conditions could be Incorporo^ed 
into the testing atmosphere. However, one thing 
can be learned which is not irrelevant to the 
kind of thinking that one will need In advanced 
icathematics: how to go from an answer to a ques- 
tion. . . . Many of us who do well on stand- 
ardized tests never bother 'doing' a problem at 
all; we search intelligently among the given 
answers, discard those that are absurd, con* 
centrate on the two or three that might do, 
and work pragmatically from the answers back 
to the question. (Since many wrong answers in 
matheraatlca are often right answers to differ- 
ent questions, this strategy also helps to elim- 
inate careless reading of problems.) 

"Building confidence Is perhaps the most 
Important task in 'math anxiety' or 'test an- 
xiety' reduction. To achieve this we try to 
get students to become more self-controlled 
(not give In to panic and stress) and to become 
more self-tnstructlve. . . . Suffice it to say 
that helping students find out what is making a 
problem difficult for them goes far toward 
achieving both goals. 

"Having said this, 1 do believe coaching 
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can be effective especially in the mathematics 
area — I am still loathe to recommend it per se^ 
both because of an increased focus on test- 
readying to the exclusion of other important 
curricolar demands, and because I would like to 
hang on to my old notion that the SAT exam is 
*^air.' (emphasis in the original] On the other 
hand, a correct analysis of vhat are the skills 
needed to do well on those examd and training 
in the use of those skClls (irrespective of the 
exams) might be worth doing in high school." 
(163] 

Vito Perrone , dean of the Center for Teach- 
ing and Learning at the University of North 
Dakota, connented that "secondary schools are 
responsibl/ for assuring that young people have 
opportunities to pursue successfully a broad 
range of academic, social-cultural and vocational 
le«rning% If the schools carry out such a respon- 
sibility well, most students who wish to go on to 
colleges and universities, as well as vocational- 
technical schools, will be adequately prepared. 
Will these students also score well on college 
admissions tescs such as the SAT and ACT? They 
mighty but assuring that students score well on 
these tests ought not be a principal objective 
of secondary schools, [emphasis in the original] 
For students seeking entry into the large number 
o£ public colleges and universities, SAT and ACT 
Scores are not particularly critical. Only in • 
the highly selective private colleges, which 
serve a very small percentage of the college- 
university population, are the test scores mat- 
ters of consequence . 

'•What could secondary schools do if they 
wished to help students score better on college 
level admissions .tests or if they wished, as 
Btsnm apparently do» to enhance their public 
image as schools where students do well on ad- 
■laalons tests. In addition to providing for 
Students the highest quality educational experi- 
ences possible, which is not in itself likely 
to guarantee that high SAT or ACT scores will 



accrue, they could, beginning in the junior 
year, organize a systematic test preparation 
program aimed at the SAT and ACT. Such a test 
preparation program would likely focus on In- 
struction in test-taking — the SAT and ACT tests 
provide logic systems and formats which are not 
characteristic of what students typically en- 
counter in their school studies — and would in- 
volve experience with past SAT and ACT tests, 
now more available as a result of the New York 
Truth-in-Testing legislation. This kind of 
assistance is offered now by a number of commer- 
cial enterprises which have begun to turn large 
profits from the ability ta pay of middle and 
upper clasfl parents. It is also offered in 
many of the nation's private schools and acad- 
emies and is becoming more common in public 
schools serving middle and upper class popula- 
tions who prefer entry into selective colleges 
and universities. Students receiving such 
test-taking instruction, and clearly the qual- 
ity of these preparation programs differ, come 
to the testing process more confident and, in 
many cases, perform better than might otherwise 
be the case. 

"If the tests are viewed as important for 
enlarging student's access to post-secondary 
educational opportunities, then schools should 
offer specific preparation opportunities." (157] 

Willard H. McGuire . president of the Na- 
tional Education Association stated that "re- 
search and firsthand reports reveal that being 
coached, being rich and having access to past 
test errors will improve high school SAT scores. 

"A National Education Asc *ation investi- 
gation and a Federal Trade Commission study show 
that coaching for college entrance exams can help 
to Improve SAT scores. A Ralph Nader pttblication. 
The Reign of ETS, discloses the relationship of 
high socio-economic status to high SAT scores. 
New laws provide for disclosure of test results, 
but proponents of the SAT disapprove and equate 
the practice with "cheating." 
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"Since high schools cannot become commercial 
coaching centers, nor can they cause more open- 
ness in testing, nor can they make the poor 
wealthy, then they must ask other questions and 
pursue other ways of assessing students. 

'*What are other ways to assess a student's 
achievements, strengths, an^ future directions 
and ambitions? Some alternate ways are: 

"Place greater reliance on a long-time 
assessment of a student by several professionals 
at the high school level. Descriptive statements 
should include a view of academic Achievement, 
strengths, personal qualities, activities, etc. 

"Emphasize the value of students' prod- 
ucts in the fields of art, science, or the 
performing arts. 

"Assess the value of work experiences and 
personal events for the student. 

"Encourage universities to hold full and 
in-depth discussions with interested students. 

"Seek to open admissions to universities, 
or establish more liberal policies for receiv- 
ing students who are willing to accept a 
challenge. * 

"A goal for education in the 80 's is 
'equity' in access for all Americans. Pursuit 
of higher SAT scores for school admissions is 
not the road to educational equity." [136] 

The American Federation of Teachers stated 
i\at "college admissions tests, such as the SAT 
and ACT, are measures of developed academic 
abilities. There has been a great deal of 
controversy recently over whether scores on 
such tests can be substantially increased 
through test coaching. Unfortunately, many of ^ ^ 
the articles which have appeared on this subject 
have been vituperative, one-sided polemics con- 
cerned more with the politics of te«?ting than 
research findings. Part of the problem has 
been imprecise use of the term coaching to de- 
scribe many different instructional activities. 

"The AiBerican Federation of Teachers be- 
lieves that short-term drill and practice 



produces minimal score changes that are more 
realistically explained through maturation and 
normal score variations. So called coaching 
activities which are of sufficient quality and 
duration to produce meaningful score changes 
are more accurately described as instruction. 
Such coaching or out-of-school instruction roost 
assuredly does and should result in greater per- 
formance on a test of developed academic abili- 
ties, [emphasis in the original] The AFT hold 
that a sound, comprehensive education, equally 
available to all students, will far better 
serve students' chances for admission to and 
success in post-secondary programs than all 
the coaching courses which may be available." 
[164] 

Scott D. Thomson , executive director of 
the National Association of Secondary School 
Principals observed that "the Scholastic Apti- 
tude Test is a measure of verbal and mathemati-r 
cal capabilities important to getting^ good 
grades in college. The mathematics section of 
the SAT examines reasoning, algebraic concepts, 
and geometric concepts. The verbal section 
examines antonyms, analogies, sentence comple- 
tion, and reading comprehension. The 'practice 
value' of the test is about 15 points, i.e., 
students who take the PSAT or the SAT will, on 
the average, increase their scores at the sec- 
ond testing by 15 points. 

"High school grades continue to be the best 
single predictor of college performance. When 
these school grades are combined with SAT scores, 
however, a more accurate prediction results than 
when the grades arc used alone. Even when em- 
ployed by themselves, the predictive validity 
of SAT scores is substantial. 

"While usefully predictive of college per* 
formance, the SATs do not measure a number of 
additional aptitudes related to student achieve- 
ment. For instance, the important intellectual 
processes of fluency and originality are not 
examined. Other qualities of a more affective 
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oature, such as social perceptivity, also are 
not a part of the SAT instrument. These fac- 
torai. together with student personality trans 
cause school grades to be more predictive than 
are the teat scores of the current college apti- 
tude tests. 

"Recommendations for improving SAT scores 
are offered within this context. They are not 
proposed as a panacea because no easy formula 
exists to what can only be the outcomes of 
serious learning oveT a period of time. They 
are not offered, either, ^or the single purpose 
of a high numerical test score. Rather, they 
are offered for the importance of what the scores 
represent — competence with verbal and mathemati- 
cal concepts. 

"English: College-bound students should 
enroll in an English class during each year of 
attendance in a secondary school. The English 
curriculum must emphasize, but not be restricted 
to, expository writing, language usage, vocabu- 
lary, and serious literature. Reading should be 
extensive as well as intensive. 

'•Mathematics: The successful completion of 
courses in algebra and geometry, as a minimum, 
is necessary to good SAT scores. A geometry 
course is helpful because it introduces the stu- 
dent to deductive reasoning, useful to problem 
resolution in many walks of life as well as with 
the SAT test questions. Geometry also provides 
experience in visualizing three-dimensional fig- 
ures and in applying formulae for areas and 
voluaee. Advanced mathematics courses, eape- 
clally Algebra II, trigonometry, and functions 
(fitlso called precalculua) increase the likeli- 
hood of good SAT score** because these courses 
maintain and reinforce important applications 
studied only briefly in algebra and geometry. 

"Ability Grouping: Students should be abil- 
ity grouped in English and mathematics as a mlni- 
MM. Ability grouping should be organized sub- 
ject by si^Ject according to the aptitude and 
prior achievemsnt of students. Schools should 
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not * track' students into broad programs such 
as 'college pfep, • 'vocational,' 'general,' 
etc. Such tracking practices ate unnecessarily 
restrictive since a student may have a high 
verbal aptitude and an average mathematics apti- 
tude, or vice versa. 

"Special Preparation: Special t^t pr'ep- 
aration opportunities should be available to 
students on a voluntary basis. Two benefits 
^accrue from a voluntary program of test prep- 
aration: (1) individual students with a strong 
need or interest may attend without obligating 
an entire class, (2) pressures to base the 
college prep English or mathematics coursers 
narrowly upon SAT content can be resisted more 
easily. Test preparation programs seldom ex- 
ceed a semester and often only .consist of 10 to 
15 meetings. Whatever their nature, stuients 
should have tha privilege of participating in 
a school-sponsored program and not be forced 
to rely upon the open market for th^is kind of 
important professional assistance. Sophistics- 
tion in test taking, as well as familiarity 
with test content, can raise student scores. 
Practice tests, therefore, should be available 
to students in the counseling de|)artments of 
schools as well as being a part of special 
test preparation courses. 

"Students and Parents: Student and pa->^ 
rental attitudes are critical to good SAT 
scores. No school curriculum, however bril- 
liantly conceived and taught, can compensate 
for student disinterest. Ambivalence is the 
dry rot of a solid academic performance. A 
strong commitment to excellence should be held 
by parents, students, and teachers. Schools 
with staMe or rising test scores credit stu- 
dents and parents with high academic aspirations 
and a connitment to work toward those aspira- 
tions." [162] 

Diane Ravitch , associate professor of 
History and Education, Teachers College, Colum- 
bia University expressed concern that the 
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subject of '*how to improve test scores" repre- 
sented a co*>fu3ion of sympcom and problem. 
Ravltch e>j»laJned, "the problem is not 'how to 
raise test scores,' but how to improve th^ abil- 
ity of students to read, write and compute, and 
beyond that, hov to restore some vision of what 
it means to be an educated person. To the ex- 
tent that declining test scores reveal declining 
competence in the mastery of the basic skills, 
then we should be alert to the danger signals. 
To disparage concerns abr 't declining test scores 
is inappropriate. We would think a medical doc- 
tor odd if he chos'^ to Ignore thermometer read- 
ings of 104®; we would also think him odd if he 
claimed that his major concern as a doctor was 
to keep all his natients at 98.6**. We would 
wonder why he was not asking questions about 
how to improve their health, rather ' *.3n focus- 
ing narrowly on how to deal with the symptoms 
ot their ill health. To stretch the analogy a 
Dit further, we would also have cause for alarm 
if the AMA (like the NEA) urged us never to use 
thermometers at all, or if consumer experts 
like Ralph Nader) demanded that all thermometers 
be banned or broken in order not to differenti- 
ate between those with fever and those without. 

"Tests should be used as a teaching tool, 
to help the teacher in gauging how well he or 
she has taught and to help the student in test- 
ing his mastery of the material to be learned. 
If we ask how to improve the teaching and learn- 
ing of the essential tools of reading, writing, 
and computing (rather than how to raise test 
scores) , then the answers should be fairly ob- 
vious. First, schools should hire tt\e best, most 
dedicated teachers to be found, should evaluate 
their performance in the classroom, and should 
provide them with assistance and opportunities 
for professional development. Second, teachers 
should give students the time, encouragement, 
and reinforcement they need to become skllxed 
in reading, writing, and computing. Third, 
schools should eittablish requirements for a 
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common curriculum, so that all students have an 
understanding of history, literature, social 
science, foreign language, art, music, mathe- 
matics, and science. Fourth, the staff should 
work with parents to set limits on television- 
watching and t ^ promote good study habits at 
home. Fifth, the staff and the community ^ihould 
cooperate to secure an atmosphere In Che schools 
that Is conducive to teaching and learning, or- 
derly, free of political pressures, and assured 
of adequate public support for education. If 
all of these conditions were met, test scores 
would not be an issue." [159] 

Philip R. Rever , director of the Washington, 
D.C., office of the American College Testing 
Program, stated that the ACT's historic position 
has been that "the results of the Assessment are 
not uniformly valid indices of secondary school 
effectiveness." Rever emphasized that "it would 
not be appropriate for ACT to guide or try to 
influence school officials' decisions about in- 
struction and curricula. Moreover, as indicated 
in our statement regarding 'coaching,' it Is not 
clear that schools c^r or are able to improve 
students' scores. Even if it were possible, a 
larger qi»*^stion remains — should schools try to 
improve students' scores on admission tests?" 
[160] 

The official "ACT Statement on Coaching" 
(October 1979) emrhasized that "the ACT tests 
are designed to measure the knowledge and skills 
that students have developed over a period of 
many years; that is, they are tests of general 
educational development. As such, they are 
Intended to indicate a student's level of 
development in the areas tested only at a par- 
ticular point in time. Growth In a student's 
capabilities will be reflected in higher test 
scores, a fact already acknowledged by ACT in 
the adjustments it makes in test scores for 
probable growth as a function of the time in 
the student's education when the test Is taken. 
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*'A11 four of the ACT tests are curriculum- 
based. The English Usage and Mathematics Usage 
tests particularly, emphasize the application of 
content specific knowledge and skills. The So- 
cial Studies Reading and Natural Sci-^nce Reading 
te^ts, while also requiring content knowledge, 
emphasize proficiency in interpretive and ana- 
lytic skills. 

**The ACT tests are used for several purposes 
including, in some instances, selection decisions 
related either to admission to undergraduate col- 
lege or to specialty programs within a college. 
The primary uses of the tests, however, are in 
acidemic advising, career counseling, placement, 
and institutional research. 

'^Because the tests are used mainly for non- 
exclusionary purposes. ACT advises examinees not 
to engage in intensive preparation for the tests. 
Careful study by students of the materials pro- 
vided by ACT at the time of test registration is 
considered sufficient for familiarizing most 
examinees with test type and format. 

*'Becai(se of the curriculum-based character 
of the tests, particularly the English and 
mathematics tests, it is possible that, for some 
students, a thorough review of the discipline 
sampled by the tests could increase their knowl* 
edge and hence, their scores on the tests. 
^ This is most likely to occur in those instances 
where the students have previously acquired the 
knowledge and skills to be tested but have used 
them infrequently and therefore have not main- 
taine<; them. 

"Intensive study in the disciplines tested 
will result in increased proficiency in the 
knowledge and skills measured by the ACT tests. 
Improvements in students' test performances and 
in their test scores will follow. Indeed a 
necessary atr^^lbute of the tests is that they 
be sensitive " instruction. Such instruction 
la compnrable to that provided through the regu- 
lar school curricula, the latter being suffi- 
cient if the students approach their studies 



in a serious fashion." [17:3] 

George H. Hanford . president of the Col- 
lege Board, in a June 1980 memo to College 
Board members, committees, and councils, stated 
that "since SAT questions call for learned re- 
sponses, and do not measure some innate capac- 
ity of an individual, the central issue in spe- 
cial preparation for the SAT is how these re- 
sponses are learned. 

"Foremost among the developed abilities 
tapped by the SAT is the ability to read with 
understanding and to reason with words and num- 
bers. One cannot point to any particular part 
of the school experience where these are taught 
to the exclusion of the rest of the curriculum. 
In fact, they are exercised and developed 
through their application to course work In a 
wide variety of academic areas and through ex- 
perience outside the classroom, [emphasis in 
the original] 

"Instructional programs designed to improve 
performance on the SAT vary along two important 
dimensions — the duration of the instruction and 
the content of the program. Common sense would 
lead one to expect more i-mprovement as more 
time and effort is spent on preparation. Sim- 
ilarly, one would expect greater improvement 
as the conten. of the program moves from drill 
and cramming on practice exercises (the tradi- 
tional meaning of 'coaching') to formal instruc- 
tion in reading comprehension and verbal and 
mathematical concepts. The general lesults of 
research studies on special preparation for the 
SAT confir^i these expectations. 

"Many t ^ the studies oft special prepara- 
tion for the bAT were sponsored by the College 
Board. These studies paid particular attention 
to the question of whether 'coaching,' meaning 
short-term drill on practice questions such as 
those contained in the SAT, Improved performance 
on the SAT. These studies hav2 repeatedly shown 
that resultant score gains are small, except in 
the case of certain groups of students for whom 
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review of mathematics was found to be beneficial. 

"However, preparation for taking the SAT can 
obviously be more extensive than such short-term 
pre-ti»8t drill. In some instances programs extend 
over eight to ten weeks with homework assignme-its 
for participants. Some schools have provided 
special cotirses for their students lasting a se- 
mester or more. These more extensive programs 
are not so much drill exercises as a focused and 
8oQ)etimes intensive educational treatment. To 
the extent that these pr^rams strengthen the 
capabilities of students to perform college- 
level work, they may represent beneficial educa- 
tional experiences, which may be reflected in 
SAT scores. 

"What- is not known is the degree of benefit 
that can be expected by a given individual under 
what circumstances » and whether such benefit, if 
realized, would represent an improvement over 
regular study with equivalent motivation of aca- 
demic subjects in school. All research relating 
to this topic to date has been subject to one or 
more design limitations wnose effect on the out- 
come remains unknown. Some studies have fewer 
such flaws than others, but none has been en- 
tirely free of them. 

**The College Board believes that the follow- 
ing statement*^ with respect to preparation for 
the SAT are reasonable Interpretatloiis uf the 
evidence now available: 

(1) The SAT measures developed verbal and 
mathematical reasoning abilities that 
are relevant to success In co''lege- 
level work; It is not a test of Im- 
'autable individual endowment. 

(2) Scores on the SAT are accordingly sub- 
ject to improvement as educational ex- 
perience, both formal and informal, 
causes these verbal and mathematical 
abilities to develop. 

(3) Development of the a>>lllties measured 
by the SAT is related to the time and 
effort spent; short-tem drill is 



likely to have little effect; well de- 
signed, longer preparation can have 
greater effect, [emphasis in the 
original ] 

(4) While drill and practice on sample 
questions show little score increase, 
such preparation familiarizes the 
student with different question for- 
mats and may reduce apprehension about 
what to expect; students can also help 
themselves to become feuniliar with 
test format and taking the test by 
using the full form of the practice 
test {Taking the SAT) with accompany- 
ing information provided by the Col- 
lege Board at no charge to each test 
registrant . 

(5) Whether longer preparation, apart from 
that available to students within 
their regular high school curriculum, 
is worth the time, effort, and money 
is a decision that individuals and 
schools must make for themselves; ef- 
fectiveness seems to vary considerably 
from program to program and for indi- 
viduals within any one prof "^ic; stud- 
ies of special preparation programs 
available in many high schools show 

a range of effects averaging about 
10 points in Verbal and 15 points in 
Math. Recent studies of commercial 
coaching show a wide variability, 
from negligible effects to average 
gains (in the case of one school) 
in the 20-30 point range for Math 
to perhaps half that for the Verbal. 
Students and schools should seek evi- 
dence that the results of a given 
program or course are likely to make 
a difference in relation to their 
college admissions objectives. 
"In general, the soundest preparation for 
the SAT, in terms of an organized educational 
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experience, is a broad academic secondary school 
curriculum with wide-r;»nging outside reading; 
in any case, SAT score increases of 20 to 30 
points correspond to approximately three addi- 
tional items correct; this e feet may as well 
or better be obtained if students pursue inde- 
pendent study i n addition to regular academic 
courses." [122:3-4] 

A Continuing Controversy: 
Future Role of Test Scores 

From its . ^tion 80 years ago, the Col- 
lege Board's statc«« commitment has been to expand 
educational opportunity and open access to higher 
education through standardized testing. [51:3] 
The accuracy, objectivity, and comparability of 
these tests have served to identify otherwise un- 
detected talent and enfranchise individuals into 
the mainstream. [69:4] During t?j past two dec- 
ides even the most selective institutions sucb 
as Harvard, Princeton, and Stanford have diver- 
sified their pools of applicants at the under- 
graduate and graduate levels. The critlct, of 
admissions tests, according to Dennis Trey cf 
the Council for Basic Education, are primarily 
interested in the relationship between testing 
and power. The leaders of teachers' unions are 
trying to "aggrandizti teacher power" and thus 
ensure that test results cannot be used to quis- 
tion the competency their membership. Accord- 
ing to Gray, testing critics such as Ralph Nader 
Delieve that the abolition of admissions tests 
will open up collef^ admissions and eventually 
corporate power will be effectively managed by 



better individuals. [117:8] 

The continuing controversy over the fairness 
of standardized college admissions tests is not 
likely to subs,ide. In June 1980, a Congressional 
truth-in-testing measure was revived for hearings 
amid discussions abou*" the meaning of the word 
'aptitude' and whether coaching improves SAT 
scores. [280:2] The National Institute of 
Education, according to former director Michael 
Timpane, is preparing to study the impact of 
testing on college admissions on a federal 
level to ensure that testing is equitable and 
leads to fair educational decisions. [212:4] 
George Hanford has acknowledged that the impor- 
tance of the SAT may be on the wane, and has 
said that the College Board is now preparing 
for a time when testing tools will be ''useful 
in earlier guidance, in placement and assiss- 
ment for remedial pruposes." [123:5] Fred M. 
Hechinger, of the New York Times observed that 
the SAT may become "an academic paper tiger 
within a few years" because colleges are hurt- 
ing from overexpansion and declining enrollments. 
He predicted that the purpose of admissions 
tests "will shift from selection to placement 
on the campus," but that admissions tests will 
be subject to attack as long as test critics 
attempt to substitute "objective judgement for 
consumers' desire." [127:8] Lastly, according 
to Andrew Strenio of the Huron Institute for 
the Nation Consortium on Testing, "if the 
testing debate bears no other fruit, perhaps it 
will at least prompt closer consideration of 
the exact functions of these standardized test- 
ing programs and the rights and interests of 
those tested under them." [266:13] 
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SUMMARY AND CONCLUSIONS 



The current national controversy over stan- 
dardized testing affects American education from 
elementary schools to Institutions of higher 
education and confronts educators, school offi- 
cials and others with difficult questions, tor 
nearly two decades many educators and much of the 
public have been concerned and alarmed by reports 
of declining college admlsslpns test scores. 
Broad media attention focusing on declining 
college admissions test scores has resulted In 
public concern and a demand for Immediate remedies 
for what many perceive to be a decline In educa- 
tional quality throughout the nation. 

College admissions tests are designed to 
measure abilities and skills developed over many 
years, both in and out of the classroom. Although 
standardized tests such as the SAT aad ACT were 
not designed to Indicate elementary or secondary 
school effectiveness, evaluate school Instructional 
programs, or Indicate an Individual's Innate 
Intelligence, such functions have become popularly 
accepted as attributes of these tests* Initially 
these tests were developed to supplement the 
college applicant's previous academic record and 
accomplishments; place applicants from diverse 
economic, geographic, and educational backgrounds 
on an equal footing; and assist In academic coun- 
seling and placement. Although college admissions 
tests continue to serve as admissions tools, they 
have gained public >^lslbllity and Interest that 
Is not In keeping with their Intended function. 
There are many who believe that the problem Is 
not specifically how to improve the test scores 



of college-bound students, but rather how to 
Improve their skills along with the skills of 
other students to read, write, compute, and 
comprehend at hlghei levels. 

The relationship between declining test 
scores and possible causal factors, and the 
relationship between special preparation or 
coaching and Improved admissions test scores, 
are highly complex, with many variables. In 
examining college admissions testing and test 
score trends, school officials and other 
concerned persons face questions such as: 
What do changes In admissions test scores 
mean for our students, school, and community? 
How can we ensure that we are providing our 
students with tht highest quality educational 
experiences possible? Should special prepa- 
ration for college admission be a major focus 
of our secondary schools? Which types of 
students might benefit the most from any such 
special preparation? How can we ensure all 
students equal opportunity of access to the 
educational Institutions of their cnolce? Are 
there better ways of assessing student potential 
for college admission? 

It Is difficult tD separate the political 
aspects of the standardized testing controversy 
from the tests ♦:hemselves and focus on practical 
educational decisions that provide the basis for 
sound education. Additional research is needed 
to determine exactly the effects of both short- 
term and long-term preparation or coaching on 
student learning, particular student populations. 



ERIC 



140 



128 



circumstances under which an individual may 
benefit from coaching, whether coaching is 
better than regular classroom instruction with 
equivalent motivation, and how this may trans- 
late into improved admissions test scores. 
Additional data are not currently available, so 
important educational decisions and policv eval- 
uations must be made based on the information at 
hand. To date this information tends to support 
the following tentative conclusions for consid- 
eration when school officials formulate educa- 
tional ^ »licies concerning changes in admissions 
test scores, the preparation of college-bound 
students for college admissions tests, how test 
scores might be improved, and related aspects 
of standardized testing. 

Trends In Standardized 
College Admissions Test Scores 

• SAT test scores for males and females declined 
between 1967 and 1980. During this 13-year 
period, the combined male md female SAT-Verbal 
score? declined 42 test points out of a total 
range of 600 test score points (from 200 to 
800). SAT-Mathematical scores declined 26 
points out of a total range of 600 test points. 
These declines appear somewhat different when 
Interpreted in terras of the number of test 
questions involved. Compared to their 1967 
counterparts, SAT test takers in 1980 answered 
approximately 6 fewer SAT-V questions correctly 
ovt of a total of 85 questions, or 7.0 percent 
fewer questions. On the SAT-M, 1980 test 
takers answered 2.88 fewer mathematical 
questions correctly out of 60 test questions, 
or 4.8 percent fewer. These two declines 
combined represent a total annual decrease 

of two-thirds of a test question for the 
average SAT test taRer over the 13-year period. 

• Between 1967 and 1980 the SAT-V scores of 
males declined 35 points (7.6 percent) and 
their SAT-M scores declined 23 points (4.5 
percent). These declines are equivalent to 
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approximately 5 fewer SAT-V questions and 
2.55 fewer SAT-.M questions answered correct- 
ly by male test takers in 1980, compared to 
their counterparts in 1967. 

• Between 1967 and 1980, female SAT-V scores 
declined by twice as much as female SAT-M 
scores, with SAT-V scores of females declin- 
ing 48 points (10.3 percent) and their SAT-M 
scores declining 24 points (5.1 percent). 
These declines correspond to approximately 
6.85 fewer SAT-V questions and 2.66 fewer 
SAT-M questions answered correctly by female 
test takers in 1980, compared to their counter- 
parts in 1967. 

• Over the past six years, the percentage of 
female SAT test takers increased steadily to 
an all-time high of 51.8 percent in 1980, 
while the percentage of male SAT test takers 
experienced a corresponding decline to 48.2 
percent . 

• The percentage of ethnic minority students 
taking the SAT has increased from 15 percent 
in 1976 to a record high of 18 percent in 
1980. Women comprise 55 percent of all 
minority test takers. 

• A comparison of SAT test score averages for 
minorities shows that between 1972-73 and 
1976-77 blacks averaged 119 SAT-V points and 
134 SAT-M points below whites, and Chicanos 
averaged 80 SAT-V points and 81 SAT-M points 
below whites [135]. Test makers claim that 
these differences are not due to bias in 

the tests but reflect the disparity in edu- 
cational opportunity for minority youths. 
They contend that, "The tests do not create 
the inequality; they reveal it." [68:3] 

• When making comparisons between two students 
on the same test, the College Board has 
stated that differences of less than 1.5 
times the standard error of the difference 
should not be considered significant. In 
other words, the scores of test takers ^lust 
Jifjet' bij niovr than the following number of 
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test score points before one can conclude with 
reasonable certainty that the higher score of 
one test taker actually represents greater 
ability or higher level of achievenyjnt than 
the lower score of another test taker as 
measured by these tests: SAT-V, 65 points; 
SAT-M, 69 points (on the College Board's 
200-to-800 scale); TSWE, 7.8 (on a 20>to-80 
scale); American History and Social Studies, 
68 points (on a 200-to-800 scale for all 
achievement tests); Biology, 63 points; 
Chemistry, 59 points; English Composition, 
71 points; English Composition with Essay, 
69-81 points;* European History and World 
Cultures, 66 points; French, 60 points; German, 
57 points; Hebrew, 42 points; Latin, 77 
points; Literature, 80 points; Math Level I, 
75 points; Math Level II, 72 points; Physics, 
62 points; Russian, 60 points; and Spanish, 
56 points. 

• Because of trie large number of points attrib- 
utable to the standard error of the difference 
when comparing the scores of two applicants 
(65 SAT-V points and 69 SAT-M points) a 
college with arbitrary cutoff scores may be 
unintentionally excluding qualified applicants 
of equal ability from consideration on the 
basis of test scores alone. For example, a 
college with a cutw»ff score of 670 on the 
SAT-V and 680 on the SAT-M may consider the 
credentials of an applicant meeting these 
initial requirements, but reject an applicant 
with scores of 605 on the SAT-V and 611 on 
the SAT-M, although there may be no essential 
difference in the abilities of the two appli- 
cants, measured by their SAT scores. The 
College Board advises both high school 
counselors and college admissions officers 
"against making fine distinctions between 
Scores. " 

• Colleges that '.lave arbitrary cutoff scores un 
the SAT, below which an applicant's credentials 
may not be reviewed, might consider establish- 
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ing broad ranges of acceptable scores in 
order to ensure that some minority students, 
underachievers, or persons who may not 
"test out'* well on standardized tests are 
not rejected from consideration based on test 
scores alone. 

• Because of tne large standard errors 
associated with the SAT and achievement 
tests, caution should be taken not to assume 
that small differences in scores represent 

a true difference in test takers' abilities 
or to assune that test takers can be ranked 
in terms of their abilities on the basis of 
small differences in their test scores. At 
best only substantial differences in test 
scores should be interpreted as significant 
indications of true differences in abilities 
or achievement as measured by the test. 

• Between 1975 and 1980, the average score for 
both males and females combined on the Test 
of Standard Written English declined by 0.8 
points from 43.2 to 42.4. Each of the 50 
test questions is worth approximately 1.0 
point on the College Board's scale of 20-to- 
80. Thus, this decrease over the past five 
years corresponds to slightly less than one 
test question. 

• Unlike the continuing decline in SAT test 
scores, achievement tests present a mixed 
picture of some test score declines, some 
stability, and some improvements. The Math 
Level I and Math Level II tests have shown 
a slight downward trend in the late 1970s 
and into 1980. The European History and 
World Cultures test, Spanish, and Latin 
tests have exhibited somewhat erratic trends. 
With the exception of a one-year aberration 

in test scores in the English Composition, the 
American History and Social Studies, and 
Physics tests, these scores have been rather 
stable. Likewise, the Chemistry, Literature, 
French, and German tests have shown overall 
stability. Test scores in Biologv and Hebrew 
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have exhibited an upward drift in the late 
19708 and into 1980, while Russian test 
scores have climbed dramatically. 

• Despite broad yearly fluctuations, when 
viewed from a perspective over the entire 
history of the Preliminary Scholastic 
Aptitude Test/National Merit Scholarship 
Corporation testing program (from 1959-60 
to 1979-80), total PSAT-V scores for males 
and females combined have declined 1.0 

test point from 41.2 to 40.2 or 2.4 percent. 
During this same period, the combned total 
PSAT-M scores for males and females have 
increased 0.3 test point, rising from 45.0 
to 45.3, or 0.7 percent. Thus, over a 
period of two decades there has been a 
decline of less than one percent (0.8 per- 
cent) in the average combined PSAT verbal 
and mathematics score for all persons tak- 
ing the tests. Each of the 65 PSAT-V 
questions and each of .the 50 PSAT-M 
questions is worth approximately 0.9 point 
and 1.0 point, respectively, on the College 
Boards 20-to-80 test score scale which 
corresponds to the SAT*8 scale of 200- to- 
800. 

• The American College Testing Program's 
Assessment Program is designed to require 
students demonstrate reasoning abilities, 
problem solving skills, and knowledge in 
four areas: English usage, mathematics 
usage, social studies reading, and natural 
science reading. The ACT has a composite 
score for the test ranging from 1 to 35 
test score points. 

• Mean Composite ACT scores for a 10 percent 
sample of males and females combined who 
took the test increased one- tenth of a 
standard score point each year between 
197S-76 and 1978-79. This increase over 
the three-year period was noteworthy, 
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according to ACT, because only once since 
1969-70 had there been an increase in the 
average Composite score. The 1979-80 ACT 
mean Composite score declined one-tenth of 
a standard score point to 18.5, the same 
level recorded in 1977-78. 

• From 1974-75 to 1979-80, ACT scores for 
both males and females rose in English, 
social studies, natural science, and on the 
Composite score. Mathematics scores of males 
declined over this period, from 19.2 to 18.9, 
while females' scores increased from 16.0 to 
16.2. 

• According to the ACT Assessment Program, a 
composite score below 14 indicates that a 
student has^ had a restricted educational 
development background; scores between 14 
and 19 are considered low average; between 
19 and 24, high average; and above 24, 
superior. The typical student in the 1979-80 
sample had an ACT Composite score of 18.9 and 
a high school grade point average of 3,0. 

• Regarding racial composition or the ACT 
sample, 75 percent identified themselves as 
Caucasian American; 7 percent, Afro-American- 
Black; and 2 percent, Mexican American/Cliicano. 

Causes of Declines in Admissions 
Test Scores 

• Theories for the decline in college admissions 
test scores include a host of possible causal 
factors such as the teaching of minimum skills 
at the expense of developing more complex 
skills; a decline in intellectual standards; 
changes in the promotion policies of schools; 
changes in the composition of the test-taking 
population; decreasing amounts of time spent 
on task; increased drug usage among high 
school students; and exposure to radioactive 
fallout from atomic bomb blasts. The extent 
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of Influence of some or all of these elements, 
if any» remains vague. 

The "blue ribbon" Advisory Panel on the SAT 
score decline, appointed by the President of 
the College Enrrance Examination Bo^rd in 
1975, concluded that there were actually two 
separate SAT score declines characterized by 
different causal factors. 

The first decline between 1963 and 1970 was 
due primarily to changes in the population 
taking the SAT. Compared to the past, the 
SAT was measuring a broader cross section of 
American youth which included larger propor- 
tions of characteristically lower scoring 
groups of students from disadvanted socio- 
economic backgrounds, ethnic minorities, and 
women. The Panel estimated that this 
accounted for two-thirds to three-quarters 
of the SAT score decline during the period. 
The second decline, according to the Advisory 
Panel, which occurred between 1970 and 1975, 
was due tc pervasive changes affecting both 
higher- and iower--s coring groups alike and 
related to eveutg in the schools and the 
society at large. The Panel concluded that 
there was no one cause for the SAT score 
decline, but rather, a "virtually seamless 
web of causal connections." 
The causal connections identified by the 
Panel included: recluced continuity of study 
in major fields; increases in student 
absenteeism; grade inflation (indicating 
declining educational standards); increased 
use of pictures, wider margins, and shorter"" 
words and sentences in textbooks; extensive 
time that students waf^hed television which 
detracted from homework and time spent 
developing academic skills, changes In the 
role of the family, especially the increasing 
number of children in single-parent families; 
changing life styles, values, higher 
mobility, drugs, and Increasing problems of 
discipline. 



• The Panel was ^unsure about how the disrup- 
tion of national life during the 1967-75 
period (Vietna i War, political assassina- 
tions, burning cities, corrupt political 
leadership) might have affected the motiva- 
tions of test takers. 3ut the Panel noted 
an apparent dimunition in students' learn- 
ing motivation. 

• The Advisory Panel continued that the SAT 
score decline was a complex subject filled 
with nuances, qualifications, and doubts. 
The SAT is a "limited instrument" and should 
not be viewed as "the sole thermometer for 
measuring the health of school, family, and 
stur' nt." 

• Although the Advisory Panel's report has 
been criticized and SAT scores have contin- 
ued to decline since the report was issued 
in 1977, the College Entrance Examination 
Board has not to date published any additional 
explanations or possible reasons for the 
continued decline in SAT scores. 

The Controversy over Standardized 
Testing 

• What was onca largely an internal debate 
within the psychometric profession concern- 
ing the design and appropriate uses of 
college admissions tests has escalated into 
a national debace- in which test makers are 
under extreme criticism, if not an all-out 
attack, from consumer groups, public 
interest groups, and educator organizations. 

• The economic and political overtones of the 
testing debate, the gravity of the asser- 
tions and counter-assertions, and the intense 
media attention, make it difficult to assess 
the true merits of arguments by both the test 
critics and test makers. 

• Among the prominent individuals and organiza- 
tions generally critical of standardized 
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testing and tte *-ole of the test makers are 
Ralph Nader and Allan Nairn, consumer advo- 
cates; Wlllard H. McGuire, president of the 
National Education Association; Benjamin L. 
Hooks, president of the National Association 
for the Advancement of Colored People; Hugh 
L. Car y, Gove^Tior of the State of New York; 
Kenneth P. LaValle, New York State Senator 
(R); Steve Solomon, New Yotk ruolic Interest 
Research Group; Lewis W. Pike, National 
Institute of Education; Warner V. Slack and 
Douglas Porter, Harvard Medical School; and 
Ted Weiss, United States Congressman (D-N.Y.) . 

• Among the prominent individuals and organiza- 
tions which in general support standardized 
testing are George H. Hanford, president of 
the College Board; Fred Hargadon, chairman of 
the College Board; William W. Turiibull former 
president of the Educational Testing Service; 
Oluf M. Davidsen, president of che American 
College Testing Program; John A.D. Cooper, 
president of the Association of American 
Medical Colleges; Albert Shanker, president 

of the American Federation of Teachers; 
Gordon M. Ambach, New York Commissioner of 
Education; and Diane Ravitch, associate pro- 
fessor oX history and education. Teachers 
College, Columbia University. 

• Highlights of some of the important criticisms 
directed toward admissions tests and the role 
of the test makers, as well as responses to 
those criticisms, follow: 

1. Standardized tests serve as gates that 
screen out disproportionate numbers of 
blacks and other minority candidates from 
employment and educational opportunities. 

Since each college establishes its own 
admissions criteria, there is no single 
gate in the admissions process. Stan- 
dardized tests, moreover, are a means of 
testing in rather than of testing out. 

2* Test takers are involuntary consumers who 
must either patronize the test makers or 
abandon their own educational plans. 



The institution to which the applicant 
applies stipulates the requirements, not 
the test maker. Many colleges exempt 
applicants from admissions tests or use 
other methods of evaluation. 

3. Test makers are not accountable for 
services purchased by the public. 

Test makers are accountable to the public. 
. Test information, including sample tests 
and interpretation of scores and their 
meanings, is widely distributed to stu- 
dents. 

A. Since testing organizations are selling 
consumer products nationwide, they bear 
little economic resemblance to other non- 
profit groups such as churches, hospitals, 
and schools. 

Because testing organizations are operat- 
ing in the public's interest, their tax- 
exempt status is similar to other nonprofit 
organizations such as churches, hospitals, 
and schools* 

5. Test makers' files contain vast amounts 
of personal, educational, and psychologi- 
cal information on millions of people. 

Test data and other information are pro- 
vided voluntarily by test takers. None- 
theless, this information is carefully 
guarded to insure confidentiality; it 
cannot be released without the candidate's 
permission. 

6. The costs of test develot;ment have been 
greatly exaggerated since it takes very 
little time to produce new rest questions 
and many of *:hese questions are reuseable. 

Test development involves detailed steps 
which are numerous, time-consuming, and 
costly, including steps to eliminate 
cultural and racial bias and pretesting 
questions before they appear on a test. 

7. Because the standard error of measurement 
is large, test scores are at best only 
approximations; yet colleges make fine 
distinctions among candidates based on 
scores that are less than the standard 
error of measurement. 

All forms of measurement and evaluation 
contain some error, including grades, 
letters of recommendation, and personal 
Interviews. Tests help eliminate unfair 
Judgments arising from grades as well as 
the old boy/old girl network. Those who 



ERLC 



If 



133 



evaluate admission materials submitted by 
students should net make fine distinctions 
among the candidates' test scores, 

8. Standardized tests such as the SAT do not 
measure aptitude, but rather how a test 
taker responded to a few multiple-choice 
questions. The results of the test are 
then presented as indicators of the qual-^ 
ity of an individual's mind. 

Standardized tests such as the SAT are 
not designed to assess inrate intelligence 
or unchanging abilities, 'i«sts do not 
measure a person's worthiness as a human 
being; they are described as aptitude 
testb because they are not tied to a spe- 
cific course of study or school curriculum, 

9. Standardized tests do not measure impor- 
tant human qualities such as creativity, 
determination, stamina, idealism, wisdom 
and Judgment, 

Standardized tests remain the best indi- 
cators of student ability regardless of a 
student's school curriculum, or socio- 
economic background; they are not designed 
to measure creativity, idealism, or other 
important human attributes. 

10. Standardized tests place blacks and other 
minorities at a disadvantage based on their 
lower than average test scores rather than 
their past school performance. 

While minority students may achieve lower 
te^t scores than whites, it is not the 
fault of the tests. Tests may reveal the 
inequality; they do not create it. Tests 
have opened doors of opportunity to 
minority and disadvantaged youths over the 
past two decades, 

11. Standardized tests rank people according 
to their family income and discriminate 
between wealthy, middle, and working 
classes. 

Test scores do relat^ to family income and 
economic background, but many students 
from high income groups earn low test 
scores, while many students from low income 
, ^ groups earn high test scores. 

12. Test scores add little to the prediction of 
college grades over the high school record 
dlone, while other forms of assessment can 
predict college success nearly as well 
better than test scores. 

Test scores provide a strong Incremental 
addition to the validity of predicting 
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college success. Moreover, test scores 
are not usually consider red by themselves 
^ but are used In conjunction with high 
school grades, letters of recomraendation , 
personal accorapllshinents , and personal 
Interviews. Tests may not be perfect, 
but they are useful, 

13. Diverse approaches are needed to assess 
properly a test taker's potential to 
perform college-level work. Because of 
economic and political considerations, 
test makeis have an interest in maintain- 
ing the status quo. 

Tests do not perpetuate an unjust social 
system. They reduce the unfairness due 
to subjective assessmentJs of personal 
qualities and serve to identify talent 
from diverse backgrounds. 

Special Preparation or Coaching for 
College Admissions Tests 

• Interest in special preparation or coaching 

bLandardized examinations for admission 
to undergraduate, graduate, and professional 
schools nationwide continues to be strong. 

• Test critics and advocates disagree on 
whettier schools can or should attempt to 
improve admissions test scores. In either 
case, both sides emphasize that special 
preparation activities should not infringe 
on ^he regular high school curriculum to 
the exclusion of other curricular needs. 

• Research findings on the effects of special 
preparation on college admissions examina- 
tions appear to be inconsistent because of 
(1) variations in the duration and quality 
of special preparation (2) effects of 
student motivation and self-selection 

(3) differential growth in verbal and 
mathematical reasoning skills over time 

(4) lack of perfection in the measuring 
instruments involved and (5) uncontrolled 
factors in research design. Consequently, 
some students might experience significant 
score increases while others might experi- 
ence significant score declines. 

11.; 
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• The wide variety in the types of test 
preparation programs currently available 
make it difficult to interpret the results 
from the research and literature on the 
possible effects of coaching for college 
admission tests. Traditionally, the terms 
"coaching" and "special preparation" applied 
only to short-term drill or practice on 
sample test questions for a few hours. 

More recently, coaching and special prepa- 
ration of longer duration, up to 40 hours, 
has been referred to as "instruction" or 
"extended educational experience." 

• There is general agreement that as special 
preparation moves irom phort-term drills 
and cramming to formal instruction of 
sufficient quality and duration in read- 
tflg compreliension and mathematical concepts 
(whether through intensive Independent 
study, additional academic courses, wide- 
ranging reading, or extendet educational 
experxences such as an 8-to-lO week 
commercial preparatory course with home- 
work) greater improvements can be expected 
in a student* 8 admissions test score. 

• Test critics maintain that a recen*" College 
Board study of the effectiveness of special 
preparation programs at eight private and 
public schools, which employed both control 
and treatment groups and averaged 13 hours 
of instruction, may have been of such short 
duration that meaningful improvements in 
test scores did not occur. 

• From 1>67 to 1980 the decline in SAT scores 
for males and females combined (42 SAT-V and 
26 SAT-M points) was 68 points. The 25 test 
points attributable to the effects of special 
preparation, as estimated by the College 
Board correspond to approximately 37 percent 
of the total decline in test scores between 
1967 and 1980. The 50 test questions attri- 
butable to the effects of special preparation, 
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in a study by the Bureau of Consun>er Pro- 
tection of the Federal Trade Commission, 
correspond to approximately 74 percent of 
the total decline in scores between 1967 
and 1980. The 100 test points attributable 
to the effects of special preparation, in 
a report by the Boston Regional Office of 
the FTC, exceed the total decline by 47 
percent. The maximum amount of test points 
ever attributed to special preparation (143 
test points, according to the National Ed- 
ucation Association Study), exceeds the 
total decline in test scores over the 13 
year period by 110 percent. 

• The possibility that JLarge numbers of stu- 
dents receive special preparation or coach- 
ing of an extended nature similar to "formal 
instruction" in commercial coaching schools 
or in special preparatory classes, especially 
in private college-preparatory high schools, 
calls into question the claims of test 
makers that standardized test scores place 
students from diverse geographic^ socio- 
economic, and educational backgrounds on an 
"equal footing." 

• There is sonie evidence that students who are 
underachievers (those who do not perform 
well on standardized admissions tests in 
light of their previous grades in school, 
class rank, and personal characteristics) 
might benefit more from special preparation 
than students of higher developed academic 
abilities. 

• The possibility that coaching and other 
forms of special preparation for taking 
standardized tests for college admissions 
could even mildly improve the test scores of 
underachievers and others, under certain 
conditions, raises the issue of possible dis- 
crimination and the denial of equal access to 
educational institutions. This is especially 
relevant for economically and socially dls- 
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advantaged students who cannot i^ford the 
cost of a commercial coaching school or who 
do not attend a high school that offers 
. special preparation or rigorous academic 
courses . 

Considering the differences in the composi- 
tion of the initial standardization group of 
10,654 college-bound high school seniors who 
were administered the SAT in April 1941 (whose 
mean score average v/as 500 and to which all 
subsequent groups of SAT takers have been in- 
directly compared), and the changing composi- 
tion of today's college youth, which includes 
one million SAT takers and greater proportions 
of Blacks, Hlspan^cs, women. an<? disadvantaged 
students than in the past, the question arises 
as to whether^ it is educationally desirable to 
maintain an "unchanging standard" for measur- 
ing college potential. 

When making decisions regarding the prepara- 
tion of college-bound students for standardized 
admissions examinations, school administrators 
and policy makers face a basic decision: do the 
relative merits of attempting to improve 
admissions test scores through a test prepara- 
tion program outweigh any possible negative 
effects to the institutional program for stu- 
dents hoping to enter colleges not relying 
heavily on admission test scores? 
In s€cond^^y schools planning to implement 
special test preparation activities there 
are a host of factors to consider, including 
whether 

1. there will be currlcular effects from 
teaching for the tests; 

2. the activities will be elective, extra- 
curricular, or incorporated Into the 
regular classroom; 

3. juniors or seniors or both should partic- 
ipate! 

4. the activities should be of short-term or 
long-term duration; 



5. the program should focus on both 
vocabulary or rr .hematical skills or 
include other content matter; 

6. commercial review books or teacher 
handouts or both should be used; 

7. homework should be assigned; 

8. the program will be free or reflect 
charges for instructional time and 
materials used; 

9. there will be any political consequences 
for test preparation activities. 

• The College Board advises secondary schools 
concerned with improving their students' 
admissions test scores to strengthen the 
regular curriculum and administer to groups 
of students the complete sample test con- 
tained in thi C^^.B booklet Taking the Sat. 
Some students who are not acquainted wirh 
the SAT may benefit from (1) a review of 
mathematical concepts, especially if they 
are not enroJled in a mathematics course; 
and (2) instruction in test-taking skills 
— including the format of the test» using 
time efficiently, knowing how to approach 
different types of questions, and knowing 
when to guess sensibly. 
• The National Education Association advises 
thau free coaching should be provided in 
order to assure "equity In access" for all 
students to the college of their choice. 
NEA further stresses that there are alterna- 
tives to admissions test which can better 
indicate a student's potential to perform 
college-level work. The teacher associa- 
tion recommends that in the admissions 
process colle^^e and unlversi ies should: 

1. place greater reliance on descriptive 
statements of students* academic 
achievement, strength, personal qual- 
ities and activities; 

2. place greater value on students* 
products i.i art, science, and the 

11. 
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performing arts; 

3. assess students' work experiences and 
personal events; 

4. encourage universities to hold dis- 
cussions with students; and 

5. open admissions to universities for stu- 
dents willing to accept a challenge. 

Truth-in-TestlfiQ Legisiation 

• New York has passed a full test disclosure law 
which requires the release of test questions 
and answers. California has enacted a limited 
test disclosure law. Similar truth-in-testing 
legislation has been introduced, postponed, or 
rejected in as many as 20 states. 

• Since the enactment of New York's truth-in- 
testing law, approximately 4.8 percent of the 
high school students taking the SAT in New York 
have requested copies of their test questions 
and answer sheets, compared to ^approximately 

17 percent of those taking the LSAT. 

• There is evidence that test sponsors such as 
the College Board and test makers such as the 
Educational Testing Service are trying to 
comply voluntarily with' consumer requests for 
more information about tests through the 
adoption of a set of "Public Interest Princi- 
ples" and by allowing students to buy back 
their SAT answer sheets and scoring keys, but 
not the test questions, and by returning PSAT 
test questions and answers to junior at no 
charge. 

• There is some evidence* that many of-sthe legal 
and administrative difficulties stemming from 
the enactment of New York's standardized 
testing l::w have been remedied through amend- 
ments to the law. Nonetheless, persons and 
groups 'caution that hastily enacted truth-in- 
testing laws, with stringent provisions and 
aive.-se educational agencies entrusted to 
enforce the laws may seriously "tie the hands 
of the test makers." 
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Use of Test Scores in the College 
Admissions Process 

• With the exception of those students 
applying to highly select colleges and 
universities, there is some evioence thac 
gaining admission to college at the under- 
graduate level is not as difficult today 
as it was in the earl' 1970s, and may be 
even \ess di f f icultc^through the 1980s. 

• High school grades are the single best 
predictor of college performance, with 

an approximate validity of .50, when both 
high school grades and standardized test 
scores are considered. There is an incre- 
mental addition of approximately .OS, with 
the combined predictors averaging about .58. 

• Colleges in general use no specific formula 
in mak^tig admissions decisions. Different 
weights, which in most cases are not pre- 
cisely defi^^ed, are assigned by each college 
and university to various admissions 
criteria such as: (1) high school academic 
performance (2) standardized test scores 
(3) extracurricular activities (4) letters 
of recommendation from teachers and counse- 
lors (5) individual talents (6) class 
rank (7) personal interviews (8) student 
motivation, and (9) previous accomplishments. 

• Statements from some college ixnd university 
admissions officers suggest that more emphasis 
is currently placed on the overall quality 
and rigor of a student's high school academic 
program than on standardized test scores 
alond. 

• Less than one percent of private four-year 
colleges and less than four percent of 
public four-year college^ consider test 
scores to be . the "single most important 
factor" in the admissions process. Never- 
theless, 5A percent of private four-year 
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colleges and 60 percent of public four-year 
colleges view admissions test scores as a 
"very important factor", according to a survey 
sponsv *-ec by the Americaa Association of 
Collegiate Registrars and Admissions Officers 
and the College Board. 

• There are sotn< ndications that in the near 
future assessments of an applicant's personal 
qualities, activities, and work experiences, 
rfhich supplement test :3Cores and grades, will 
play a greater role in the selection of appli- 
cants for crllege admission and possibly expand 
the admissions process. 

• Provided that an applicant meets a college's 
minimum cutoff test score, if one exists^ the re 
is evidence that college admissions officers 
review all of the materials they can obtain on 
an in Ividual applicant in order to assess the 

mt's potential to perform college-level 

wo rk. 

How Test Scores Might Be .;<iproved 

• Statements by educators and officials from 
colleges and universities professional 
associations representing educators in various 
areas (such as reading, English, mathematics, 
and secondary schools) national teacher organ- 
izations, and test makers provide an array of 
recommendations for improving the standardized 
test scores of secondary school students. 

• The most frequently cited recommendation by 
educators for improving college admission test 
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scores is the importance of ^ strong 
secondary school curriculum, including 
3-4 years of English and mathematics, 
broad ranging student reading, and an 
increased emphasis on written English. 

• Other frequent recommendations for 
improving test scolcs include a serious 
commitment to education by patents and 
the community, a familiarization of 
students with test formats, and practice 
with test materials provided by the 
test makers. 

• Some believe that soecial preparation, 
whether contained within the traditional 
high school curriculum or obtained through 
commercial coaching schools, will help 
students raise their test scores. But 
others, in particular the test makers, 
contend that coaching is not really 
necessary for students to excel on che 

SAT or the ACT. Instead they emphasize 
the importance of a strong overall 
curriculum experience for students. 

• When considering possible responses to 
declining college admissions test scores 
and ways to increase such scores, it is 
impcrtdiic to take into account that these 
tests are designee to measure higher 
levels of reading and mathematical com- 
prehension. Sc^ ol programs designed 

to improve college admission test scores 
should not be confused with programs to 
improve functional literacy or minimum 
competency . 
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APPENDIX A 

"Application Proc«Hure9" Excerpted from the "Joint Statement on Principles of Good Practice in 
College Admissions and Recruitment,'* Developed by the American Association of Collegiate Registrars 
and Admissions Officers, the College Board, the National Association of College Admissions Coun- 
selors, and the National Association of Seconc'ary School Principals 



1. Colleges and universities will: 

A. Accept full responsibility for admissions decisions and for proper notification of 
those decisions to candidates and, when possible, to secondary schools. 

B. Receive information about candidates in confidence and respect completely, within the 
confines of federal and/or state laws, the confidential nature of such data. 

C. Not apply newly revised requirements to the disadvantage of a candidate whose secondary 
school course has been established in accordance with earlier requirements. 

D. Notify candidates as soon as possible if they are clearly inadmissible. 

E. Not deny admission to a candidate on the grounds that their institution does not have 
aid funds to meet the candidate's apparent financial need, except for foreign students. 

F. Not require candidates or their schools to indicate the order of candidates' college or 
university preferences, except under early-decision plans. 

G. Permit candidates to choose, without penalty, among offers of admission until they have 
heard from all colleges to which they have applied, or until the date established under 
the Candidates Reply Date Agreement. 

H. Maintain a waiting list of reasonable length and only for a reasonable period of time. 

I. State clearly the application procedures for transfer students by informing candidates 
of deadlines, documents; required, courses accepted, and course equivalency. 

2. Secondary schools will: 

A. Provide for colleges and universities accurate, legible, and complete transcripts for 
their school's candidates. 

B. Describe their school's marking system and method of determining rank in class. 

C. Describe clearly special curricular opportunities (e.g., honors, advanced placement 
courses, seminars, etc.). 

D. Provide accurate descriptions of the candidates' personal qualities that are relevant to 
the admissions process. 

E. Report any significant change in candidates' status or qualifications between the time 
of recommendation and graduation. 

F. Urge candidates to recognize and discharge their responsibilities in the admissions 
process by: 

• complying with requests Cor additional information in a timely manner; 

• responding to institutional deadlines on admissions and refraining from stockpiling 
acceptances; 

• responding t institutional deadlines on room reservations, financial aid, health 
records, and. prescheduling where all or any of these are applicable. 
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G. Nor, without permij^sion of candidates, reveal the candidates* college preference. 

H. Advise students not to sign any contractual agreement with an institution without 
examining the provisions of the contract. 

I. Advise students to notify other institutions when chey have accepted an admissions 
offer . 

3. Community agencies will: 

A. Exercise their responsibility to the entire educational community. 

B. Discourage unnecessary multiple applications. 

C. Discourage students from stockpiling offers of admission. 



SOURCE: American Council on Education. "Self-Regulation initiatives: Guidelines for Colleges 
and Universities." Washington, DC: ACE, October 1979, p. 2. 
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APPENDIX B 

The Mathematical Association of-Aroerica and the National Council of Teachers of Mathematics 
Position Statement on "Recotmoendations for the Preparation of High School Students for College 
Mathematics Courses." 



The Board of Governors of the Mathematical Association of America and the Board of Directors 
of the National Council of Teachers of Mathematics make the following recommendations: 

1. Proficiency in mathematics cannot be acquired without individual practice. We, there- 
fore, endorse the common practice of making regular assignments to be completed outside 
the class. We reconmend that parents encourage their children to set aside sufficient 
time each day to complete these assignments and that parents actively support the request 
of the teachers that homework be turned in. Students should be encouraged to develop 
good study habits in mathematics courses at all levels and should develop the ability 

to read mathematics. 

2. Homework and drill are very important pedagogical tools used to help the btudent gam 
understanding as well as proficiency in the skills of arithmetic and algebra; but 
students should not be burdened with excessive or meaningless drill. We, therefore, 
recomir'3nd that teachers and authors of textbooks step up their search for interesting 
problems that provide the opportunity to apply these skills. We realize that this is a 
difficult task, but we believe that providing problems that reinforce manipulative skills 
as a by-product should have high priority, especially those that show that mathematics 
helps solve problems ,.n the real world. 

J. We are aware that teachers must struggle to maintain standards of performance in courses 
at all levels from kindergarten through college and that serious grade inflation has been 
observed. An apparent growing trend tc reward effort or attendance rather than achieve- 
ment has been making it increasingly difficult for mathematics teachers to maintain 
standards. We recommend that mathematics departments review evaluati i procedures to 
Insure that grades reflect student achievement. Further, we urge administrators to 
support teachers In this endeavor, 

4. In light of 3 above, we also recognize that advancement of students without appropriate 
achievement has a detrimental effect on the Individual student and on the entire class. 
We, therefore, recommend that school districts make special provisions to assist students 
when deficiencies are first noted, (emphasis in the original) 

5. We recommend that cumulative evaluations be given throughout each course, as well as at 
ltj> completion to all students, (emphasis in the original] We believe that the absence 
of cumulative evaluation promotes short-term learning. We strongly oppose the practice 
of exempting students from evaluations. 

6. We recommend that computers and hand calculators be used in imaginative ways to reinforce 
learning and to motivate the student as proficiency in mathematics Is gained. Calcula- 
tors should be used to supplement rather than to supplant the study of necessary 
computat lona* skills . 

7. We recommend that colleges and universities administer placement examinations in mathe- 
matics prior to final registration to aid students in selecting appropriate college 
courses . 

8. We encourage the continuation or Initiation of joint meetings of college and secondary 
school mathematics instructors and counselors in order to improve communication concern- 
ing mathematics prerequisites for careers, preparation of students for collegiate mathe- 
matics courses. Joint curriculum coordination, remedial programs in schools and colleges, 
an excnange of successful instructional strategies, platinlng of in service programs, and 
other related topics. 
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9. Schools should frequently review their mathematics curricula to t,ee that they meet the 
needs of their students in preparing them for college mathemat icb . School districts 
that have not conducted a curriculum analysis recently should do so now, primarily to 
identify topic in the curriculum which could be either omited or de-eraphasized , if 
necessary, in order to provide suf lent time for the topics included in the above 
statement. We suggest that, for exci ^)le, the following could be de-eraphasized or 
omitted if now In the curriculum; 

a. logarithmic calculations that can better be handled by ealculaLors or coniputers, 

b. extensive solving rf ttiangles in ti igonometry , 

c. proofs of superfluous or trivial theoreaic> in geometry. 

10. We recommend that algebraic concepts and skills be incorporated wherever possible into 
geometry and other courses beyond algebra to help students retain these concepts and 
skills. 



SOURCE: The Mathematical Association of America and the National Council of Teachers of 
Mathemacics. "Recommendations for the Preparation of High School Students for 
College Mathematics Courses." Washington, DC: MM, n.d,, p. 4, 
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APPENDIX C 

National Council of Teachers of Mathematics "Recommendations 
for School Mathematics of the 1980s" 



The National Council of Teachers of Mathematics recommends that — 

1. problem solving be the focus of school mathematics in the 1980s; 

2« basic skills in mathematics be defined to encompass more than computational facility; 

3. mathematics programs take full advantage of the power of calculators and computers at 
all grade levels; 

4» stringent standards of both effectiveness and efficiency be applied to the teaching of 
mathematics; 

5* the success of mathematics programs and student learning be evaluated by a wider range of 
measures than conventional testing; 

6. more mathematics study be required for all students and a flexible curriculum with a 
greater range of options be designed to accommodate the diverse needs of the student 
population; 

7* mathematics teachers demand of themselves and their colleagues a high level of 
professionalism; and 

8* public support for mathematics instruction be raised to a level commensurate with the 
importance of mathematical understanding to individuals and society. 



SOURCE: The National Council of Teachers of Mathematics* An Agenda for Action: Recommendations 
for School Mathermtics of the 1980s, Reston, VA: NCTM, 1980, p. 1. Copyright 1980 by 
The National Council of Teachers of Mathematics, Reston, VA. 
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APPENDIX D 

'^National Testing Movement": Basic Policy Statement, Resolutions on Education, National Associ- 
ation for the Advancement of Colored People, 1979 



Whereas, the use of tests is escalating in our society and standardized tests in some in- 
stances are proposed as the sole criteria for nonpromotion of students; and. 

Whereas, state legislation autnorizing competency testing for high school studtnts has 
spread to 36 states and proposals are being discussed at the P^ederal level to require a national 
test for high school graduation; and, 

Whereas, increased use of testing is being imposed with changes in the curriculum, in- 
service teacher training or the effective use of diagnostic-prescriptive measures to assess 
student needs; and. 

Whereas, such untrammeled use of testing instruments is another way of blaming the student 
Vict im; 

Therefore, be It resolved, that the NAACP work for truth in testing legislation at the 
Federal level; 

Be it also resolved, that the NAACP reaffirm its policy demr iding a moratOiium on standard- 
ized testing wherever such tests have not been corrected for cultural bias; and. 

Be it further resolved, that the NMCP adamantly oppose the use of testing results in an 
adverse fashion and any movement geared to the use of scores on a national test a^ p''erequisi te 
for high school graduation. 

Be it also resolved, that we direct our units to request specific information from schools 
re: courses and programs including goals and objectives, planned activities and substance; 
measures used for evaluation, expectations for student and teacher competencies and sample assign- 
ments required for success in the course or program. 

Be it finally resolved, that the national office develop a positive national strategy to 
implement this resolution. 



SOURCE: National Association for the Advancement of Colored People. "National Testing Movement. 
Basic Policy Statement, Resolutions on Education. Washington, DC: NAACP, 1979, 
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APPENDIX E 

Operational Elements of "Puolic Interest Principles for the Design and Use of Admissions Testing 
Programs," Proposed by the College Board, Educational Testing Service, Graduate Management Admis- 
sion Council, Graduate Record Examinations Boaril, and Law School Admission Council 



The separately constituted and governed groups sponsoring testing programs may choose to im- 
plement these principles in different ways. This probable diversity stems from differences in the 
nature and purposes of the tests in the several programs and from the specifics of their structure 
and operation. Examples of possible approaches include the following; 

1. Each prospective examinee should be able to receive a full-length sample of each test, 
similar to the one he or she will take, with the intended answers and with instructions 
for self-administration and self-scoring. 

2. For tests given co a sufficient number of students annually to support the cost, at least 
one operational form of the test should be published periodically, in addition to the 
regular sample. A specific schedule of publication should be designated for each program. 

3. Non-technical information about the testing program should be furnished routinely to 
test-takers, users, and the general public. It should include a description of what each 
test measures, the error of measurement, how the scores are intended to be used, and a 
summary of the validity of the scores for the intended uses. 

4. A technical publication should provide information on the same topics in sufficient depth 
to permit professionals in the field to assess the evidence and the accuracy of the non- 
technical summary. 

5. Studies of the use of the test by professionals other than those in the sponsoring or 
administering agency should be actively encouraged and facilitated by provision of the 
necessary data with safeguards for individual privacy. The results of those studies 
should be published in regular journals and also incorporated in the technical and 
non-technical publications. 

6. The test sponsor should ensure that operational forms of the tests are independently 
reviewed before they are given. The review should include the appropriateness of the 
content of the test and in particular should seek to detect and remove potential racial, 
cultural or sex bias or other influences extrinsic to the characteristics, skills or 
knowledge to be measured. The review should also determine that the operational form 
is fairly represented by the sample test already distributed. 

7. Test takers should have the right to question the accuracy of scoring, administrative 
procedures, specific questions in a test, or allegations of irregularities in test 
administrations. Current procedures to deal with this right should be reviewed and 
modified if necessary to ensure a fair and prompt response. 

We hope communication of these principles and operational guidelines leads to greater under- 
standing and constructive dialogue about the important issues surrounding testing. We stand 
ready to work with all interested groups in discussion of the policies and improvement of thf- 
procedures under which testing programs are conducted. 



SOURCE: Educational Testing Service. "Public Interest Principles for the Design and Use of 
Admissions Testing Programs." Princeton, NJ: ETS, January 2, 1980, p. 3. 
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